databricks-search-column-tool an open source notebook to search Databricks catalog

Davi Abdallah Davi Abdallah

Davi Abdallah

Tech Manager, AI & Data Lakehouse Principal Architect, and Distributed Parallel Data Processing Expert working closely with Data Science, Cloud Engineering, and Dev Ops Teams.

发布日期: 2022年7月12日
+ 关注

databricks-search-column-tool

search column tool (all databases or selected databases) for databricks

  1. Create a new Databricks Notebook for your databricks-search-column-tool
  2. Add to cells
  3. Cell 1, add the contents of create_allColumns_tempView.py
  4. Edit Cell 1, line 30: db_list = ['raw'] # [x[0] for x in spark.sql("SHOW DATABASES").rdd.collect()] 4.1 List desired databases or [x[0] for x in spark.sql("SHOW DATABASES").rdd.collect()] for all databases in the catalog
  5. Cell 2, add the contents of allColumns.sql (edit where clause for desired column name, database, etc 5.1 The view allColumns contains database (string), tableName (string), and columnName (string), use the SQL language for desired query crieria
  6. Run the databricks-search-column-tool notebook

Get the tool at:

要查看或添加评论，请登录

Davi Abdallah的更多文章

社区洞察

其他会员也浏览了