Kensu Documentation

⌘K
Getting started with the Kensu Community Edition
Marketing campaign
Financial data report
Getting credentials
Recipe: Observe Your First Pipeline
Agents: getting started
Python
PySpark
Scala Spark
Databricks Notebook
Agent Listing
Docs powered by archbee 
5min

Marketing campaign

Context

The Marketing department of the city store regularly organizes a phone campaign to communicate sales offers to the customers having bought any article in the last months.

The list of customers and phone numbers that the marketing team has to contact is recorded in a Postgres table which is created on demand by a pipeline.

Description

The pipeline uses Python and dbt programs.

When triggered, the pipeline runs:

1. data_load.py, declined in two versions, load_first_campain.py ans load_second_campain.py, which sends two files to a Postgres table: the articles ordered during the period and the list of customers. The first table contains information about the orders, while the second one contains personal information about the customers.

2. Marketing, a dbt project with 2 models:

  • The first model, orders_and_customers.sql will join both data tables created by data_load
  • The second one, contact_list.sql, creates a list of customers the team will contact

Here is the flow:

Representation of the marketing pipeline including data observability
Representation of the marketing pipeline including data observability




Program Steps

In this example, after having performed the Installation and configuration, you will be able to:

  • Observe your pipeline data observability information embedded in the pipeline. This includes:
    • Data sources metadata
    • Technical data lineage
    • Data profiling (metrics)
    • Rules for dbt outcome
  • Use the technical data lineage to analyze the propagation of an error and Prevent further issues

Next step Installation and configuration



Updated 24 May 2022
Did this page help you?
Yes
No
UP NEXT
Installation and configuration
Docs powered by archbee 
TABLE OF CONTENTS
Context
Description
Program Steps