Virtual Database Manager Overview
Virtual Database Manager Overview
VDM resolves metadata accessibility problems by providing a virtualized data warehouse, which allows for SQL-based access to data elements that are not directly accessible through standard reporting tools, including metadata in blob formats. This is achieved by exposing data in a virtual star schema accessible through conventional SQL tools, overcoming the intrinsic limitations of SAP BusinessObjects' native document access .
VDM enhances data governance by providing a virtual framework that ensures real-time, unbiased access to diverse data types without physical data movement, which is critical for auditing, compliance, and analytics. This neutrality ensures that reports and analyses are based on the most current and accurate data while maintaining independence from specific data storage systems .
The lexer/parser in VDM is critical for analyzing SQL requests to determine the most cost-effective path for data retrieval. It identifies the data requirements, associated virtual tables, and necessary pre- and post-treatment filters. This intelligent query processing ensures efficient and accurate data access, facilitating real-time analysis and minimizing processing delays .
Thomas Trolez, the founder of SoftNtic SAS, conceptualized the Virtual Database Manager as a core component of the Enterprise Connector product. His vision was to provide a real-time representation of required data through a virtual data warehouse, enabling the utilization of standard analysis and reporting tools .
Real-time data warehousing challenges include data latency, integration complexity, and performance optimization. VDM addresses these by using a virtual approach that minimizes data duplication and latency, allowing instantaneous access to up-to-date information. Its architecture is designed to optimize query paths and efficiently manage data through a virtual framework, overcoming the physical constraints of traditional warehousing .
Key components of VDM include virtual star schema, virtual fact and dimension tables, a JDBC driver, and a lexer/parser for SQL request analysis. These components collectively determine the best path to data retrieval, manage virtual table associations, and apply pre- and post-treatment filters. The system further relies on encoder/decoder mechanisms to access data from original systems, such as using the SAP BusinessObjects Enterprise SDK .
VDM employs a virtual star schema with virtual fact and dimension tables, contrasting with traditional data warehousing models that physically store data. It uses a virtual database framework to present data as though available in traditional tables, permitting SQL-based access through a conventional JDBC driver. This setup facilitates real-time data access and eliminates the need for data duplication .
VDM's virtual star schema allows dynamic data representation without physical storage constraints, providing flexibility in adjusting to data needs without restructuring physical databases. This enhances analysis capabilities, allowing real-time data manipulation, reduced costs, and improved query responsiveness, which are limitations in traditional systems with fixed physical schemas .
VDM allows for real-time access to non-relational data without copying it, enabling efficient reporting and analysis using standard SQL. It enhances data governance processes by providing neutral access to information and supports SAP BusinessObjects' needs for analyzing security control, license compliance, and other document relationships .
The JDBC driver in VDM acts as a bridge between the virtual data presentations and reporting tools, allowing these tools to interact with data as though accessing traditional databases. This integration enables the use of standard SQL in reporting tools, facilitating seamless access to the virtual data warehouse and leveraging existing analytical capabilities and resources .