Links to slides from Video
This week I've been thinking about Data Discovery. It was interesting to catch some ideas from technologists and enthusiasts using other platforms, and try to align that with "what does Domo do well?" or "what kind of automations or tools can we use to do Domo better?"
Organize MetaData into Schemas
An idea I liked was this idea of organizing metadata into a schema (a structured table) potentially based on tags. So I did a loooonnnngggg tutorial about that.
The idea being, you schema could include concepts (what was the data about? a customer, projects expenses, item sales, opportunities or leads?) And this would be separate from the data source. Customer data could come from Hubspot, SalesForce, Dynamics or Shopify.
We know we'd ultimately combine all this raw data into a dashboard dataset in ETL, but for the Data Scientist or Data Governance team, wouldn't it be grand if the data center was a little more searchable without crawling through the lineage diagram?
Using Networks to discover data
Another interesting idea I came across was the idea of conducting a network analysis to see which datasets are interesting. I.e. "You're related to this person (in a social network) therefore you might be interested in this dataset."
Domo does have that built into the product, but it's not reportable. An interesting challenge might be to try to automate maintaining the employee chart API and intersect that with the activity log API to see which cards or datasets your boss uses and then report that in a card.
I think the truly fascinating question is to say "how do you know if a dataset is valuable?" and then convert that into a solution!
Stuff you'd want to Automate
Grant S talked about a process for deleting or archiving aging content by using a weighted average scoring method.
Other Metrics of interest might include adherence to naming conventions, the presence of descriptions or tags, certification, and frequency with which columns are used.
On the Analyzer side, the big one was finding a way to identify duplicated or overlapping beast modes.
Google is Copying Domo.
Or maybe Domo is copying Google. Either way it was interesting to see the overlaps in their technology/offering.