You will be responsible for analyzing data for our virtual power plant from hundreds of thousands of devices and millions of data points per day. You will create pipelines and scalable storage solutions that enable analysis of data from distributed energy resources like electric vehicles, batteries, thermostats, solar, and smart hot water heaters, in service of our utility programs.
You will collaborate with cross-functional teams, including product managers, software developers, and user interface developers, to ensure that our software solution provides accurate data for utility customers.
Responsibilities
•Design, implement, and maintain efficient data pipelines for ingesting high-volume time-series data from multiple sources.
•Optimize data storage using scalable solutions (e.g., columnar stores, time-series databases, data lakes).
•Build and manage ETL/ELT processes to ensure data integrity, quality, and availability.
•Develop solutions to query, aggregate, and analyze time-series data in real-time and batch modes.
•Grow our analysis into a Hadoop-like Big Data job.
•Support visualization efforts in Tableau
•Build forecasting using AI models along with other team members to predict value provided to utilities.
•Ensure our scheduling service accurately collects data from devices.
•Collaborate with product and design teams to deliver the underlying data to demonstrate impact, enthrall customers, and meet business objectives.
•Follow engineering best practices, including code quality, testing, CI/CD pipelines, and agile methodologies.
•Ensure system reliability, scalability, and performance for time-sensitive data processing.
•Monitor data flows and build alerts for anomalies or failures in pipelines.
Qualifications
•Bachelor’s degree in Computer Science, Software Engineering, or an Engineering field.
•3+ years of experience in large-scale data analytics
•Experience building & operating scalable, high-performance Big Data systems (Hadoop, Spark, Azure Synapse Analytics, etc).
•Strong understanding of software architecture principles, data modeling, design patterns, and best practices.
•Experience with cloud platforms (AWS and Azure) and microservices architectures.
•Experience with Big Data databases and distributed systems.
•Strong problem-solving skills with the ability to analyze complex technical challenges and implement effective solutions.
•Excellent communication and collaboration skills, with the ability to work across teams and communicate technical concepts to non-technical stakeholders.
•Knowledge of DevOps practices and CI/CD pipelines.
•Experience with containerization technologies like Docker and Kubernetes.
•Knowledge of security best practices in software development.
•Familiarity with agile development methodologies (Scrum, Kanban, etc.).
Preferred Experience
•Knowledge of the electricity grid and utilities.
•Knowledge of energy markets, demand response, or virtual power plants.
•Proficiency in Salesforce, Tableau, and Mulesoft.