Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions docs/metaflow/publish.md
Original file line number Diff line number Diff line change
Expand Up @@ -106,3 +106,6 @@ Notes:
- Invalid `status`/`sla` values raise `ValueError` before any data is written.
- Tagged tables surface in the `TABLE_OWNERSHIP_REGISTRY` view (see
[Table-ownership registry view](table_ownership_registry.md)).
- The underlying Snowflake session always has `QUOTED_IDENTIFIERS_IGNORE_CASE = TRUE`
set (`snowflake_connection.py`), so quoted identifiers in `query`/`audits` resolve
case-insensitively.
6 changes: 6 additions & 0 deletions docs/metaflow/publish_pandas.md
Original file line number Diff line number Diff line change
Expand Up @@ -80,6 +80,12 @@ publish_pandas(
until then tagging is **skipped with a warning** and the publish still succeeds.
- Invalid `status`/`sla` values raise `ValueError` before any data is written.

## Notes

- The underlying Snowflake session always has `QUOTED_IDENTIFIERS_IGNORE_CASE = TRUE`
set (`snowflake_connection.py`), so quoted identifiers resolve case-insensitively
regardless of `quote_identifiers`.

## Limitations

- When `use_s3_stage=True`, some column data types may not map exactly as expected between pandas/parquet and Snowflake.
Expand Down
6 changes: 6 additions & 0 deletions docs/metaflow/query_pandas_from_snowflake.md
Original file line number Diff line number Diff line change
Expand Up @@ -35,6 +35,12 @@ query_pandas_from_snowflake(

**Returns:** `pd.DataFrame` query results with lowercase column names.

## Notes

- The underlying Snowflake session always has `QUOTED_IDENTIFIERS_IGNORE_CASE = TRUE`
set (`snowflake_connection.py`), so quoted identifiers in `query` resolve
case-insensitively.

## Limitations

- `use_s3_stage` does not support Snowflake `TIMESTAMP_TZ` and `TIMESTAMP_LTZ` data types.
Expand Down
2 changes: 1 addition & 1 deletion pyproject.toml
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
[project]
name = "ds-platform-utils"
version = "0.5.0"
version = "0.5.1"
description = "Utility library for Pattern Data Science."
readme = "README.md"
authors = [
Expand Down
1 change: 1 addition & 0 deletions src/ds_platform_utils/metaflow/snowflake_connection.py
Original file line number Diff line number Diff line change
Expand Up @@ -88,6 +88,7 @@ def _create_snowflake_connection(
# so we have to execute a raw query to set it.
try:
conn.execute_string("USE WAREHOUSE {}".format(warehouse))
conn.execute_string("ALTER SESSION SET QUOTED_IDENTIFIERS_IGNORE_CASE = TRUE")
Comment thread
abhishek-pattern marked this conversation as resolved.
except Exception as e:
raise RuntimeError(f"Failed to set Snowflake warehouse to {warehouse}: {e}") from e
Comment thread
abhishek-pattern marked this conversation as resolved.

Expand Down
2 changes: 1 addition & 1 deletion uv.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Loading