Skip to content

Releases: os-climate/osc-ingest-tools

v0.2.1

11 Dec 00:02
df7a3f3
Compare
Choose a tag to compare

release consumes pr #8

  • add new colmap kw parameter that allows direct sql type override per column name
  • expose both typemap and colmap to the utility function unmanaged_parquet_tabledef
  • add new kw args catalog and schema to attach_trino_engine (also verbose)

v0.2.0

05 Dec 15:07
0167dcb
Compare
Choose a tag to compare

Adds several new utility functions to help reduce boilerplate in notebooks and standardize conventions

__all__ = [ 
    "sql_compliant_name",
    "enforce_sql_column_names",
    "enforce_partition_column_order",
    "pandas_type_to_sql",
    "create_table_schema_pairs",
    "attach_s3_bucket",
    "upload_directory_to_s3",
    "load_credentials_dotenv",
    "attach_trino_engine",
    "drop_unmanaged_table",
    "drop_unmanaged_data",
    "ingest_unmanaged_parquet",
    "unmanaged_parquet_tabledef",
]

v0.1.1

12 Nov 22:26
Compare
Choose a tag to compare
  • adds the optional typemap parameter to create_table_schema_pairs

v0.1.0

28 Oct 22:37
Compare
Choose a tag to compare

initial release

  • enforce_sql_column_names(df)
  • create_table_schema_pairs(df)