Skip to main content

Vaults

Vaults are secure storage repositories in DeepDQ that manage your data quality configurations, historical results, and system metadata. They provide a centralized and secure way to store all your data quality assets and database connection configurations.

What are Vaults?​

Vaults serve as secure containers that store your data connection configurations for various data warehouses and databases. Each vault contains the necessary credentials and connection parameters to securely connect to your data sources, enabling DeepDQ to:

  • Sentinels: Run read-only SQL-based data quality monitoring queries
  • Power Data Catalog: Discover and catalog your database schemas and tables
  • Enable Data Lineage: Track data flow and relationships across your data infrastructure
  • Support DAB Chatbot: Allow the DeepAnalyze Bot to query your data for insights
  • Perform Analysis: Execute various read-only data quality and analytics operations

Supported Vault Types​

DeepDQ supports a wide range of database and data warehouse platforms:

PostgreSQL​

Open-source relational database with robust features and reliability.

MySQL​

Popular open-source database management system known for speed and ease of use.

Snowflake​

Cloud-native data warehouse platform designed for scalability and performance.

SQL Server​

Microsoft's enterprise-grade relational database management system.

Databricks​

Unified analytics platform for big data processing and machine learning.

BigQuery​

Google Cloud's fully managed, serverless data warehouse.

Redshift​

Amazon's cloud-based data warehouse service optimized for analytics.

Oracle​

Enterprise-grade relational database management system with advanced features.

For detailed configuration instructions, authentication methods, and best practices for each database type, click on the links above to access the individual database documentation pages.

Security Features​

All vault configurations in DeepDQ include enterprise-grade security features:

  • Encrypted Storage: All passwords and sensitive credentials are encrypted at rest
  • Secure Transmission: All connections use secure protocols (SSL/TLS)
  • Access Control: Role-based access control determines who can view or modify vault configurations
  • Audit Logging: All vault access and modifications are logged for compliance

Managing Vaults​

Creating a New Vault​

  1. Navigate to the Vaults section in DeepDQ
  2. Click "Add Vault" button
  3. Select the appropriate database type
  4. Fill in the required connection parameters
  5. Save the vault configuration. This will also test the connection and the vault will be created only once the connection is successful.

Editing Vault Configurations​

  1. Select the vault from the list
  2. Click the vault name to open the edit dialog
  3. Modify the necessary parameters
  4. Save the updated configuration. This will also test the connection and the vault will be updated only once the connection is successful.

Best Practices​

  • Naming Convention: Use descriptive names that identify the environment and purpose (e.g., "Production_Sales_PostgreSQL")
  • Credential Management: Regularly rotate passwords and update vault configurations
  • Connection Testing: Periodically test vault connections to ensure they remain valid
  • Access Control: Limit vault access to only necessary team members
  • Network Security: Contact salesandsupport@deepanalyze.ai to get the DeepDQ Static IP for database firewall rules where required
  • Documentation: Maintain documentation of what data sources each vault connects to

Getting Started​

To get started with vault configuration:

  1. Choose your database type from the supported options
  2. Refer to the specific database documentation for detailed setup instructions
  3. Gather the required connection parameters and credentials
  4. Create and test your vault configuration
  5. Begin using DeepDQ features:
    • Set up Sentinels for automated data quality monitoring
    • Enable Data Catalog for schema discovery and management
    • Configure Data Lineage to track data relationships
    • Use DAB Chatbot to query your data with natural language

For database-specific configuration guides, authentication methods, and troubleshooting information, please visit the individual database type documentation pages.