Original LinkedIn Post
cwprep: Generate Tableau Prep data flows from code
Adam Mico
As a data engineer, have you encountered these pain points?
Manually dragging nodes in Tableau Prep is inefficient The process cannot be version controlled, making team collaboration difficult Repeated ETL processes require repeated configuration Data processes cannot be automated through AI Today, I open sourced cwprep ? a Python SDK that lets you generate Tableau Prep data flow files (.tfl) from code.
Core functions:
Multiple data input (SQL query / direct connection table) Join & Union operations Data cleaning (filtering, renaming, calculated fields) Aggregation & Pivot Transformation server output
Code example:
from cwprep import TFLBuilder, TFLPackager
builder = TFLBuilder(flow_name="Sales Analysis") conn = builder.add_connection(host="localhost", dbname="superstore") orders = builder.add_input_sql("Orders", "SELECT * FROM orders", conn) builder.add_output_server("Output", orders, "Sales_Data")
flow, display, meta = builder build() TFLPackager.pack_zip("./output", "./sales.tfl")
Current limitations (early v0.1.0):
Currently only testing is completed in the MySQL environment Other databases (PostgreSQL, Oracle, etc.) theoretically supported but not fully verified Some advanced features are still under development Welcome to submit Issues and PRs to help improve
looks sample to test, and check the skills to konw how to use.
Installation: pip install cwprep pypi: GitHub: https://lnkd.in/g7rYvZDF
This is an early version and we're really looking forward to feedback and contributions from the community! Welcome Star
#DataEngineering #Tableau #Python #OpenSource #ETL #AI #datafam #prep #tableau #tableauprep