Loading Portfolio

Available for opportunities
🕐 — · Coimbatore, IN

Hello, I'm

Shanjai R

Software Engineer II · M.Tech Data Science, BITS Pilani

Data Engineering · Data Science · E-commerce Intelligence · Analytics

Building data systems that turn messy market data into business intelligence.

Currently Building SARA: a fashion & retail intelligence pipeline

Shanjai R
Scroll to explore

01 About

About Me

I work where messy data meets real-world systems.

RoleSoftware Engineer II
CompanyPromptCloud / 42Signals
LocationCoimbatore, India
LanguagesTamil · English

I work where messy data meets real-world systems. As a data scientist, my work sits across data engineering, analytics and e-commerce intelligence — building pipelines, processing systems and analytical workflows that turn raw marketplace and web data into something teams can actually use, including SARA, my current work in fashion and retail intelligence.

I tend to look beyond the immediate technical problem. When data fails, I want to understand why. When a pipeline works for five sites, I ask whether it will still work for a hundred. And when a dashboard contains thousands of metrics, I want to know which of them can actually change a decision — the kind of thinking laid out in more detail in how I think about systems.

Over the last few years, I have worked across data collection, processing, validation, infrastructure, analytics and intelligence systems. This has given me a perspective that sits somewhere between engineering and problem-solving: build reliable systems, understand the data flowing through them, and keep the final business decision in view. See what's changed because of that work for a few concrete examples.

I'm currently expanding that foundation through my M.Tech in Data Science at BITS Pilani, while continuing to work on data-driven systems in the e-commerce intelligence space.

What I'm Building Now Updated Aug 2026
💼
Currently Working On Turning raw marketplace and web data into market intelligence, competitor analysis, pricing signals and search intelligence
🎓
Currently Studying M.Tech Data Science coursework at BITS Pilani
🔭
Currently Exploring LLM-powered data extraction, intelligent data pipelines and AI-assisted market intelligence
📖
Currently Reading Designing Data-Intensive Applications, by Martin Kleppmann
Current Focus Areas

Data ScienceMachine LearningE-commerce IntelligenceData InfrastructureCompetitor IntelligenceData-Driven Decision SystemsAI-Assisted Analytics

My Journey

The Story Behind the Work

2018 – 2020

The Unlikely Beginning

School days: computers were never my favourite subject. I never imagined building a career around technology. I didn't connect with programming and honestly thought it was something meant for naturally "tech people." I was not one of them.

2020 – 2024

B.Tech IT: Finding My Calling

Pursued Information Technology at Sri Shakthi Institute of Engineering and Technology. Struggled early, then discovered a real passion for data extraction and logic-driven problem solving. Graduated with 8.58 CGPA, First Class with Distinction.

Jul 2023

PromptCloud: Where Learning Became Real

Joined as a Software Engineering Intern. Worked on banner placement analysis for Amazon, Nykaa, and Blinkit: identifying where brand banners appear inside app layouts and connecting technical findings directly to business strategy.

Jul – Dec 2024

Associate Software Engineer: Taking Ownership

Built the Client Site Mapping Dashboard for 42Signals and designed a Modular Web Scraping Pipeline with YAML-driven rules, MySQL integration, and multi-layer validation. Philosophy: build systems, not shortcuts.

Jan 2025

Software Engineer I: Leading the Product

Full ownership of 42Signals product operations, handling multiple client engagements, driving new explorations, and earning the Emerging Leader award for ownership and leadership initiative.

Oct 2025

BITS Pilani: Never Stop Learning

Enrolled in M.Tech Data Science and Engineering through the Work Integrated Learning Program. Goal: move beyond operational execution into strategic, AI-driven analytics leadership.

Jul 2026

Software Engineer II: Raising the Bar

Promoted to Software Engineer II at PromptCloud / 42Signals, working at the intersection of data engineering, automation, and data science to turn raw web and app data into meaningful business insights across e-commerce and quick commerce.

● Now

Mentoring & Still Building

Conducting mock interviews for college juniors: resumes, Python, logical thinking. Because guidance matters enormously at the start. And for me, this is only the beginning.

🎯

My Vision

Build systems that solve real problems people actually face, not just what looks impressive. Clarity, structure, and long-term impact over short-term noise.

🚀

My Mission

Take ownership. Refine until it's right. Grow into someone who doesn't just contribute, but leads, shapes outcomes, and makes things meaningfully better.

"
I don't just complete work; I refine it until it feels right. Ownership isn't assigned to me. It comes naturally.

02 Experience

Where I've Worked

2026 – Present

Software Engineer II

PromptCloud / 42Signals · Bengaluru

Data Engineering · E-commerce Intelligence · Automation · Analytics

Building and maintaining data systems that power e-commerce intelligence, including marketplace data pipelines, analytics workflows, competitive intelligence and automation.

  • Built and maintained data pipelines supporting marketplace intelligence workflows.
  • Worked across collection, processing, validation and analytics.
  • Investigated data-quality issues and translated client problems into technical improvements.
  • Built analytical systems for competitor intelligence, pricing and search visibility.
  • Worked across engineering and business contexts to understand how data should influence decisions.
PythonData AnalysisElasticsearchKibanaMySQL
2025 – 2026

Software Engineer I

PromptCloud / 42Signals · Bengaluru

Data Engineering · Analytics Pipelines

Converted raw web and app data into actionable business insights for e-commerce and quick commerce, detecting trends and anomalies through automated validation and quality checks, and defining data quality standards across teams.

PythonData AnalysisElasticsearchKibanaMySQL
2024

Associate Software Engineer

PromptCloud · Bengaluru

Systems Design · Data Pipelines

Designed and implemented scalable systems for processing large datasets with high reliability, applying statistical techniques to support business decisions and optimizing pipelines for throughput and accuracy.

PythonBeautifulSoupScrapyMySQL
2023 – 2024

Software Engineering Intern

PromptCloud · Bengaluru

Web Scraping · Data Extraction

Built scalable web scraping pipelines with configurable site adaptors for pagination, content fetching, and data extraction, supporting market research and content aggregation projects.

PythonRubyBeautifulSoupNokogiriXPath

03 Skills

Technical Toolbox

Currently Learning · Applied Data Science for Market Intelligence using Web Data

Data Engineering

PythonSQLMySQLETLData PipelinesData ProcessingData Quality

Infrastructure

RabbitMQElasticsearchDockerLinuxGitDistributed Processing

Analytics & Intelligence

Data AnalysisCompetitive IntelligencePrice IntelligenceSearch IntelligenceMarket IntelligenceE-commerce Analytics

AI & Data Science

Machine LearningData ScienceLLMsLangChainHugging FaceOpenAIPandasNumPy

Web & Data Systems

JavaScriptHTMLXPathDOMBeautifulSoupRequests

04 Education

Academic Background

🎓

M.Tech Data Science and Engineering

Birla Institute of Technology and Science, Pilani

Oct 2025 – Aug 2027 Current CGPA: 8.58
🎓

B.Tech Information Technology

Sri Shakthi Institute of Engineering and Technology

Nov 2020 – Apr 2024 CGPA: 8.58  ·  First Class with Distinction
📚

Schooling, Biology-Maths

SVGV Matric Hr Sec School & Vijayalakshmi Matric Hr Sec School

Jun 2016 – Mar 2020

05 Recognition

Awards & Honours

🚀 ×1

Emerging Leader

Awarded for impeccable ownership of the 42signals product, driving multiple client engagements, leading new explorations, and demonstrating strong leadership initiative.

🏆 ×2

Stretch Award

Recognized for going above and beyond on key projects, consistently exceeding expectations and delivery targets.

×5

Hi5 Award

Celebrated for exceptional teamwork, collaboration, and sustained positive impact across cross-functional teams.

06 Selected Work

Selected Work

01

SARA

Scalable Automated Retrieval Architecture

Currently Building

An architecture for building scalable, reliable data retrieval systems with reusable components for collection, fetching, extraction, validation and downstream processing — currently applied across 22 fashion e-commerce and media sites, indexed into Elasticsearch as a searchable intelligence layer.

PythonRabbitMQElasticsearchKibanaFastAPIStreamlitAPScheduler
Read the Case Study
02

Competitor Intelligence Engine

Competitor Analysis · Market Intelligence

PromptCloud / 42Signals

A product-level intelligence system that identifies and ranks marketplace competitors using product names, inferred brands, categories, pricing and similarity signals.

PythonElasticsearchKibanaMySQL
Read the Case Study
03

Automated Product Matching Pipeline

Fashion Retail Client · Digital Shelf Analytics

PromptCloud / 42Signals

A system for connecting products across marketplaces using product attributes and similarity signals to improve cross-market analysis.

PythonData ValidationElasticsearch
Read the Case Study
04

Search Intelligence & Brand Visibility Analytics

Search & Keyword Insights

PromptCloud / 42Signals

A search-performance intelligence system covering keyword rankings, brand visibility, competitor movement, rank distribution and product-level performance.

PythonKibanaData Analysis
Read the Case Study
05

Price Intelligence & Revenue Leakage Detection

Demand Signals · Pricing

PromptCloud / 42Signals

A marketplace pricing intelligence workflow designed to identify meaningful price discrepancies while reducing noise from irrelevant or low-value data fields.

PythonMySQLElasticsearch
Read the Case Study
06

Modular Web Scraping Pipeline

PythonMySQLBeautifulSoup

A modular pipeline for URL collection, fetching and rule-based extraction using Python, YAML, MySQL, CSV and web parsing components.

Read the Case Study

07 Writing

Notes & Observations

The Person Who Knows How the Company Works Has More Leverage Than the Person Who Knows the Most

The Person Who Knows How the Company Works Has More Leverage Than the Person Who Knows the Most

Understanding why a system was built a certain way is worth more than knowing the most code. Two pipelines that looked logically separate turned out to be split only because of an outdated client requirement; recognizing that led to roughly a 50% reduction in analytics cost. "The code tells you what. The history tells you why."

The Deepest Peace is Found in Chaos

The Deepest Peace is Found in Chaos

Society romanticizes peace as quiet beaches and minimalist spaces, but the real thing is different. Coming home during festivals, chaotic and loud as it is, produces a calm no silence ever could. "Peace is not the absence of noise. Peace is the presence of a safety net."

The Art of Poking Around

The Art of Poking Around: How Curiosity Made Me a Better Engineer

Responsibility defines deliverables. Curiosity drives growth. Poking around a product beyond what's assigned (every dashboard, filter, and edge case) surfaces problems raw data never shows on its own. "The most valuable engineering skill isn't writing better code. It's being curious enough to keep poking around."

A Watchtower Without a Watchman Is Just Architecture

A Watchtower Without a Watchman Is Just Architecture

Every dashboard, alert, and automation you build adds a system, and every system needs an owner, or it just becomes hidden risk. "A watchtower without a watchman is just architecture. A dashboard without an owner is just a chart."

Security Is Not Living Inside an Iron Dome

Security Is Not Living Inside an Iron Dome

Repeatedly firefighting the same emergencies is a design problem, not an effort problem. Real strength isn't living inside an iron dome of manual fixes and constant monitoring; it's building systems that stay stable as complexity grows. "Security is not just protection. It is resilience by design."

Beyond Work

When I'm Not Coding

✈️

Travel

Chasing sunsets in Poovar, palace views in Udaipur: experiences that shift perspective more than any textbook ever could.

Poovar IslandUdaipurMore coming
📸

Photography

Capturing candid moments and landscapes. Every frame holds a memory worth keeping.

🎓

Mentoring

Mock interviews for college juniors: resumes, Python, logical thinking. Giving back what I wish I had at the start.

10+ sessions
🎵

Music I Love

Artists & songs
Group BTS K-pop
Solo Shreya Ghoshal Bollywood
All-time fav 🔁 GO GO BTS
Current fav NORMAL BTS

10 Contact

Get In Touch

Working on a data problem?

Building a data pipeline, analytics system, market intelligence product, or something somewhere between them? I'd be interested in understanding the problem.

Ready to collaborate?

Say Hello

Drop me an email and I'll get back to you within 24 hours.

Send a Message
Hire Me
📋 Email copied!