Engineering Intelligence.

I'm Sunando, a Principal Software Engineer at Red Hat. I define the architecture for massive data systems and build the next generation of AI-powered applications.


Technical Expertise

Generative AI & LLMsAgentic WorkflowsPrincipal EngineeringData EngineeringDatabricks & SparkSnowflake Data CloudKubernetes & OperatorsApache KafkaScala & PythonSystem DesignAWS CloudRAG Architecture

Engineering Highlights

Built a high-scale hybrid retrieval system using Reciprocal Rank Fusion, combining BM25 and Vector Search for precise enterprise knowledge retrieval.

RAGVector SearchGeminiPinecone

Developed an autonomous multi-agent coding assistant capable of planning, writing, and reviewing code with human-in-the-loop oversight.

AI AgentsAnthropicPythonTool Use

Led the architectural migration of legacy on-demand clusters and EMR workloads to optimized Databricks Unity Catalog environments.

DatabricksSparkCloud MigrationScala

Pioneered a Change Data Capture (CDC) framework for event-driven architectures using Apache Kafka and Spark Structured Streaming.

KafkaStreamingEvent-DrivenJava

Career History

Apr 2024 - Present
Red Hat

Principal Software Engineer

Leading data engineering initiatives and architectural patterns for enterprise hybrid cloud solutions. Driving technical strategy for scalable data platforms.

2021 - 2024
Databricks

Lead Data Engineer

Specialized in migrating Fortune 500 clients from legacy Hadoop/EMR to the Databricks Lakehouse. expert in Spark optimization, Unity Catalog, and Delta Lake implementations.

2019 - 2021
JPMorgan Chase & Co.

Data Engineer

Engineered robust financial data pipelines handling petabyte-scale transactions. Implemented strict governance and security controls for banking data.

2016 - 2019
Accenture

Application Development Analyst

Delivered big data solutions for Nordic financial institutions. Focused on KYC application development and real-time customer analytics using Hadoop ecosystem.