Trabajos

Data gobernance

Development of data gobernance tool «Truedat». It features a business concept glossary, data structure catalog, lineage and data quality. Other highlights are structure grouping in knowledge domains, permission management by role and user, subscription to event notifications and templates for concepts and structure «notes».

The backend code is public. You can check for my contibutions at any repos that start with td-. Some of the most relevant are:

You can also search by author:

git log --author="Julio"

This page shows some of the tasks I was involved with.

Custom catalog views

TD-4986: The Truedat catalog stores tables and columns’ names and hierarchy. The user can add additional metadata on them. This task filters the tree that these structures form, showing just the paths that reach the filtered data, excluding the rest. It runs on dynamic indexing and ElasticSearch scripts.

Asynchronous execution

Avoids making the user wait in front of the browser, launching tasks in the background, and showing their progress. Uses Elixir’s Task.async.

Asynchronous tasks: CSVs and lineage processing
Asynchronous tasks progress panel

CSV data upload

Business concepts graphs

TD-5798: filtering graphs by labels: the user and relate business concepts, adding optional labels. This task limits the graph extent to the chosen labels:

Grants

Grants are permissions assigned to data structures. They do not have any effect inside Truedat; instead, the user queries them for its internal processes. For example, accessing table data, writing table data, etc.

Data quality

It counts how many rows/data follow certain rules/conditions for a structure.