Skip to main content

MySQL Vault Configuration

MySQL vaults provide secure connections to MySQL databases, enabling comprehensive data quality monitoring and analysis across your MySQL infrastructure.

Overview​

MySQL is one of the world's most popular open-source relational database management systems. DeepDQ's MySQL vault integration enables comprehensive data quality monitoring through Sentinels, schema discovery for Data Catalog, relationship tracking for Data Lineage, and powers the DAB Chatbot with query capabilities.

Configuration Parameters​

Required Fields​

  • Name: A unique identifier for your MySQL vault
  • Type: MySQL (automatically selected)
  • Host: The hostname or IP address of your MySQL server
  • Port: The port number (default: 3306)
  • Database: The name of the database to connect to
  • Username: The database username for authentication
  • Password: The database password (securely encrypted)

Example Configuration​

Name: Production MySQL Vault
Type: MySQL
Host: your-mysql-host.example.com
Port: 3306
Database: your_database
Username: your_username
Password: [encrypted]

Supported MySQL Versions​

DeepDQ supports the following MySQL versions and variants:

  • MySQL 5.7.x
  • MySQL 8.0.x
  • MySQL 8.1.x
  • MariaDB 10.x (MySQL-compatible)
  • Percona Server for MySQL

Connection Requirements​

Network Access​

  • Ensure network connectivity between DeepDQ and MySQL instance
  • Configure firewall rules for the specified port (default: 3306)
  • For cloud deployments, verify security group and VPC settings
  • DeepDQ Static IP: Contact salesandsupport@deepanalyze.ai to get the Static IP for whitelisting

Database Permissions​

The MySQL user requires these minimum privileges:

  • SELECT privilege on tables to be monitored
  • USAGE privilege for basic connection rights
  • SHOW DATABASES privilege for schema discovery
  • INFORMATION_SCHEMA access for metadata queries

Example privilege grant:

GRANT SELECT ON your_database.* TO 'deepdq_user'@'%';
GRANT SHOW DATABASES ON *.* TO 'deepdq_user'@'%';
FLUSH PRIVILEGES;

SSL/TLS Support​

DeepDQ supports secure MySQL connections:

  • SSL encryption for data in transit
  • Automatic SSL detection and usage when available
  • Enhanced connection security

Common Use Cases​

Sentinel-Based Data Quality Monitoring​

  • Execute SQL queries for automated data validation
  • Monitor data integrity and consistency
  • Track business rule compliance
  • Detect data anomalies and outliers

Data Catalog Management​

  • Automatic discovery of MySQL schemas and tables
  • Metadata extraction and documentation
  • Schema evolution tracking
  • Data dictionary maintenance

Data Lineage Visualization​

  • Map data relationships within MySQL databases
  • Track data transformations and dependencies
  • Monitor ETL/ELT process impacts
  • Visualize data flow patterns

DAB Chatbot Integration​

  • Natural language querying of MySQL data
  • Conversational data exploration
  • Automated insights generation
  • Interactive business intelligence

Best Practices​

Security​

  • Create dedicated MySQL users for DeepDQ
  • Implement principle of least privilege
  • Use SSL/TLS encryption for all connections
  • Regular password rotation and security audits

Performance​

  • Optimize queries with appropriate indexing
  • Monitor connection pool efficiency
  • Configure query timeout settings
  • Use read replicas for monitoring workloads

Maintenance​

  • Regular connection health monitoring
  • Track MySQL performance metrics
  • Monitor storage and connection limits
  • Implement backup and recovery procedures

Troubleshooting​

Common Connection Issues​

Access Denied Errors

  • Verify username and password
  • Check user privileges and grants
  • Validate host-based access restrictions
  • Review MySQL user account status

Connection Timeout

  • Check network connectivity and latency
  • Verify MySQL server availability
  • Review connection timeout settings
  • Monitor server load and performance

SSL/TLS Issues

  • Validate SSL certificate configuration
  • Check SSL mode requirements (REQUIRED, PREFERRED, etc.)
  • Verify certificate authority and trust chain
  • Review MySQL SSL configuration

Performance Issues​

Slow Query Performance

  • Analyze query execution plans
  • Review table indexing strategies
  • Monitor MySQL slow query log
  • Check server resource utilization

Connection Pool Exhaustion

  • Monitor active connection count
  • Review connection pool configuration
  • Optimize connection lifecycle management
  • Implement connection retry logic

Advanced Configuration​

Connection Options​

MySQL vaults support additional connection parameters:

  • autoReconnect: Automatic connection recovery
  • useSSL: Force SSL connections
  • serverTimezone: Handle timezone differences
  • characterEncoding: Specify character set

High Availability​

For production environments:

  • Configure automatic failover capabilities
  • Implement connection retry mechanisms
  • Use MySQL replication for read scaling
  • Monitor vault health and connectivity

MySQL-Specific Features​

Storage Engine Support​

DeepDQ works with all MySQL storage engines:

  • InnoDB (recommended for ACID compliance)
  • MyISAM (for read-heavy workloads)
  • Memory (for temporary data)
  • Archive (for historical data)

Character Set Handling​

  • Automatic character set detection
  • UTF-8 encoding support
  • Collation-aware data processing
  • Multi-language data support