One-man engineering team.

← All projects

Dremio Engineer

Dremio Engineer — image 1

Client

DPD Group

Category

Free-lance

Visit
As part of the DATAHUB team at DPD Group, I worked on the deployment and optimization of Dremio on Kubernetes, using Helm Charts and MinIO-based distributed storage to improve performance and scalability. I developed Python automation tools for metadata backups, API-driven queries, and incremental data ingestion to ensure consistency across environments. I also built internal FastAPI services to expose analytical datasets to business units, reduced manual reporting, and implemented GitLab CI/CD pipelines with Grafana monitoring to support reliable and observable data platform operations.

Technologies

PythonPython
RedisRedis
AWSAWS
DremioDremio
PostgresSQLPostgresSQL
Azure DevopsAzure Devops
GrafanaGrafana
KubernetesKubernetes
LokiLoki
PrometheusPrometheus