Example Script: Get table names used by data source

[susodapop]

Type of PR

• Feature

Description

Adds a script that shows which tables of a SQL data source are used in queries. It checks table names against the data source schema (if available). If schema is not available then CTE's and temporary tables are included in the output. No way around this AFAIK.

Example

$ python3 find-table-names.py URL APIKEY DS_ID

              table | number of queries
------------------- | -----------------
            queries |               213
      organizations |               201
             events |               157
              users |               106
       data_sources |                81
      query_results |                61
         dashboards |                56
     visualizations |                37

The --detail flag prints a CSV stream of query_id and table_name pairs to stdout. Like:

2168,queries
2168,organizations
1432,queries
1431,queries
1431,organizations

This is meant for writing to disk:

$ python3 find-table-names.py URL APIKEY DS_ID --detail yes > tables.csv

Can also be invoked as a console_script

$ find-tables URL APIKEY DS_ID

or from within the project directory:

$ poetry run find-tables URL APIKEY DS_ID

Related Issues

#10

[susodapop]

I ran black over this before committing. I don't care for the restyled changes.