Integration
...
Collectors
Matillion

Configure Matillion Collector

7min
setting up matillion for data observability in this tutorial, we will guide you through the necessary steps to effectively set up and configure matillion for data observability the tutorial is structured as follows setup matillion connection using matillion token (estimated task time 5 minutes) here, we'll walk you through the process of setting up a connection with matillion using a matillion token configuration of the matillion collector (estimated task time 2 minutes) the final step focuses on configuring the matillion collector for data observability this involves setting up the necessary parameters and options within matillion to collect, monitor, and manage your data effectively before you begin configuring the matillion collector, ensure you have the following a kensu hub instance with the preinstalled matillion component a matillion user login and password with the api access (see matillion doc ) configuration navigate to the matillion collector 1\ navigate to your kensu hub url https //xxxxx hub kensuapp com/ https //demo hub kensuapp com/kensu hub components plugin/#/connections 2\ under the data application collectors section, find the matillion collector click on configure to proceed setting up the connection in the dependencies, you need to create the connection to your matillion instance within the dependencies section, locate the matillion option and click "configure" to start setting up the connection 2\ click the + icon to add a new connection 3\ fill in the connection details as follows conn id choose a unique identifier for your connection host enter the matillion host url, formatted as https //your matillion instance url/rest/v1/ login and password use credentials for a matillion user account with at least read and api access rights ensure to input only the necessary information as specified above, there is no need to modify the other fields 4\ click submit to save the new connection 5\ click on back to come back to the collector home page configure the collector 1\ navigate to the configuration panel within the kensu hub components collector matillion cell, click on configure 2\ click on the + icon this action will generate a new configuration file 3\ you can now edit the configuration, by adding environment names specify the names of the matillion environments you wish to monitor project names enter the names of the matillion projects you're interested in observing in the specified section, choose the appropriate kensu and matillion connections for this configuration you can select the default kensu connection or create your own 4\ click on submit all congratulations! you've successfully set up the collector it will be activated shortly, and you will begin monitoring your matillion jobs the collector will allow the retrieval of lineage, data sources, and job information to allow full data observability, it is important to create the data source connections, which will also retrieve the schema and metrics of the tables used in the jobs to do so, please follow snowflake docid\ ojharjtq6htyg8q24uf9o