0.9.2 (Dec 05, 2024)

Added

• infer_data_types(), load(), and load_async() methods. Combined with the existing create_table() and data_transaction() methods, they form the preferred way to create tables and load data into them.

• atoti_jdbc.JdbcLoad.parameters to bind variables to queries and avoid SQL injection.

• Runtime check that atoti.OidcConfig.scopes includes the required "openid" scope.

Documentation

• Pressing the y key after clicking on an anchor in a page under https://docs.atoti.io/latest/ will permalink the URL by replacing latest with the corresponding version.

Changed

• Upgraded Atoti Server to 6.1.2.

• Upgraded Atoti UI and Atoti Admin UI to 5.2.3.

• To support remote clusters, atoti.Session.read_spark() and atoti.Table.load_spark() convert the passed Spark DataFrame to an in-memory Pandas DataFrame instead of exporting it to a Parquet file.

Deprecated

• atoti.Table.append():

  - table.append(*rows)
  + table.load(pd.DataFrame(rows, columns=list(table)))
  

• atoti.Table.load_arrow():

  - table.load_arrow(arrow_table)
  + table.load(arrow_table)
  

• atoti.Table.load_csv():

  - table.load_csv(path)
  + table.load(tt.CsvLoad(path))
  

• atoti.Table.load_kafka():

  - table.load_kafka(...)
  + from atoti_kafka import KafkaStream
  + table.stream(KafkaStream(...))
  

• atoti.Table.load_numpy():

  - table.load_numpy(numpy_array)
  + table.load(pd.DataFrame(numpy_array, columns=list(table)))
  

• atoti.Table.load_pandas():

  - table.load_pandas(pandas_df)
  + table.load(pandas_df)
  

• atoti.Table.load_parquet():

  - table.load_parquet(path)
  + table.load(tt.ParquetLoad(path))
  

• atoti.Table.load_spark()

  - table.load_spark(spark_df)
  + table.load(spark_df.toPandas())
  

• atoti.Table.load_sql():

  - table.load_sql(query, url=url)
  + from atoti_jdbc import JdbcLoad
  + table.load(JdbcLoad(query, url=url))
  

• atoti.Session.read_numpy():

  - table = session.read_numpy(numpy_array, columns=columns)
  + table = session.read_pandas(pd.DataFrame(numpy_array, columns=columns))
  

• atoti.Session.read_spark():

  - table = session.read_spark(spark_df)
  + table = session.read_pandas(spark_df.toPandas())
  

• atoti.Session.read_sql():

  - table = session.read_sql(query, table_name=table_name, url=url)
  + from atoti_jdbc import JdbcLoad
  + jdbc_load = JdbcLoad(query, url=url)
  + data_types = session.tables.infer_data_types(jdbc_load)
  + table = session.create_table(table_name, data_types=data_types)
  + table.load(jdbc_load)
  

• create_table(), read_arrow(), read_csv(), read_pandas(), read_parquet()’s types parameter. Use the data_types parameter instead.

• Inference of read_csv() and read_parquet()’s table_name parameter. Pass a table_name argument instead.

Fixed

• RecursionError being raised when passing more than 296 cases to where().

• KeyError being raised when using a Level as a key in switch()’s cases parameter.

• Snapshotting of widget in JupyterLab >= 4.2 by setting windowingMode to "defer".