Data Catalog

Data catalogs are a game changer when it comes to data access and analysis. Traditionally, data was accessed from a data warehouse and then analyzed by using BI tools like BusinessObjects and Cognos. However, with companies storing more data they can no longer be confined to just a data warehouse. Platforms like Hadoop have made it possible to expand data storage through the implementation of data lakes. The departure from using a single location for data storage has resulted in a need to effectively access all the new data that a company collects and stores.

Internal Data

THE CHALLENGE

This kind of project is divided into two: the business process and the technical process. Both components come with their own kinds of challenges.

At the business level, an organizational glossary is required in order for data cataloging to be effective. The glossary describes each of the key concepts within the company, how they are measured, who is responsible, where it can be found etc. A project of this type usually comes from the management and requires business understanding, the ability to lead processes with the various management personnel in the organization and the technical ability to connect the business language used to the level of data stored in the various sources of information.

The technical process is more simple to implement and it is recommended to start here when there is no pressing need for a business glossary. This process involves the consolidation of all existing data sources in the company to a central metadata system which is why proper management of this system is required. If every piece of company data can now be accessed it would be reasonable to make sure that it is possible to manage who sees what. It is also worth considering adding additional technical information to the catalog, like loading frequency.

Vision.bi has partnered with Alation, which is one of the leading data cataloguing service providers, as its official representative in Israel. In addition, Vision.bi has practical experience in large projects in Israel with informatics tools and in leading selection processes in order to adapt customers to the most suitable product.

Want to learn more?

WHY US ?