Common Functions

Introduction #

SmartPip provides rich built-in functions supporting file upload, data retrieval, email sending, shell execution, SQL execution, Kettle tasks, and more. Call custom functions via the #diy driver for flexible task logic.

Built-in Functions Quick Reference #

Function Description Notes
File upload smart_upload(csvfilepath)
Get data get_dataset(id, param={})
Send email dash_mail(title, content, maillist)
Execute shell run_bash(cmdStr)
Execute datax run_datax('DAG_name/task_name', para_dict)
Execute SQL run_sql_file('DAG_name/task_name', db_connect='starrocks', para_dict=None)
Execute Kettle run_kettle('DAG_name/task_name.ktr', para_str='')
Execute SP run_sp(sp_name, sp_para=None, dev='', db_connect='oracle')

Note:

  • para_dict is a dictionary-format parameter