<div class='\"job-descr' content> Who We Are Bidgely (which means \"electricity\" in Hindi) is an AI-powered SaaS Company accelerating a clean energy future by enabling energy companies and consumers to make data-driven energy-related decisions. Ranked #7 in Applied AI on Fast Company’s list of Most Innovative Companies in the World, Bidgely is putting customers at the center of the clean energy future. What We Do Powered by our unique patented technology, Bidgely's UtilityAI™ Platform transforms multiple dimensions of customer data - such as energy consumption, demographics, and interactions into deeply accurate and actionable consumer energy insights. We leverage these insights to empower each customer with personalized recommendations tailored to their individual personality and lifestyle, usage attributes, behavioral patterns, purchase propensity and beyond. How We Do It From a distributed energy resources (DER) and grid edge perspective, Bidgely is advancing smart meter innovation with data-driven solutions for solar PVs, electric vehicle (EV) detection, EV behavioral load shifting and managed charging, energy theft, short-term load forecasting, grid analytics and time of use (TOU) rate designs. Bidgely’s UtilityAI™ energy analytics provides deep visibility into generation and consumption for better peak load shaping and grid planning and delivers targeted recommendations for new value-added products and services. For more information, please visit <a href="%5C%22https://www.google.com/url?q=https://www.bidgely.com/&amp;source=gmail&amp;sa=D&amp;sa=E%5C%22">www.bidgely.com</a> or the Bidgely blog at <a href="%5C%22https://www.google.com/url?q=http://bidgely.com/blog&amp;source=gmail&amp;sa=D&amp;sa=E%5C%22">bidgely.com/blog</a>. How You Fit In Responsibilities 1. Gather and assemble large, complex sets of data that meet non-functional and functional business requirements. Skills: SQL, Python, R, Data Modeling, Data Warehousing, AWS (S3, Athena). 2. Create new data pipelines or enhance existing pipelines to accommodate non-standard data formats from customers. Skills: ETL Tools (e.g., Apache NiFi, Talend), Python (Pandas, PySpark), AWS Glue, JSON, XML, YAML. 3. Identify, design, and implement internal process improvements, including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes. Skills: Apache Airflow, Terraform, Kubernetes, AWS Lambda, CI/CD pipelines, Docker. 4. Build and maintain required infrastructure for optimal extraction, transformation, and loading (ETL) of data from various data sources using AWS and SQL technologies. Skills: SQL, AWS Redshift, AWS RDS, EMR (Elastic MapReduce), Snowflake. 5. Use existing methods or develop new tools/methods to analyze the data and perform required data sanity validations to ensure completeness and accuracy as per technical and functional requirements. Skills: Python (NumPy, Pandas), Data Validation Tools, Tableau, Power BI. 6. Work with stakeholders including Customer Onboarding, Delivery, Product, and other functional teams, assisting them with any data-related technical or infrastructure-related issues. Skills: Stakeholder Communication, JIRA, Agile Methodologies. 7. Provide actionable insights into key data metrics (volumes, trends, outliers, etc.), highlight any challenges/improvements, and provide recommendations and solutions to relevant stakeholders. Skills: Data Analysis, Data Visualization Tools (Tableau, Looker), Advanced Excel. 8. Coordinate with the Technical Program Manager (TPM) to prioritize discovered issues in the Data Sanity Report and own utility communications. Skills: Project Management Tools, Reporting Tools, Clear Documentation Practices. Expectations from the Role: 1. Be the primary owner of the data sanity process internally. Skills: Data Quality Management, Python (Data Validation Libraries), SQL Auditing. 2. Run defined sanity checks/validations on utility data to ensure data accuracy and completeness. Skills: Python, SQL, QA Tools, AWS QuickSight. 3. Create the data sanity report using the established process and template. Skills: Report Automation Tools, Excel Macros, Python. 4. Provide actionable insights into key data metrics, highlighting any challenges/improvements in the data. Skills: Business Intelligence Tools (Tableau, Power BI), Statistical Analysis Tools. 5. Assess issues in the data as per the technical and functional requirements of the implementation and flag critical issues to the TPM. Skills: Root Cause Analysis, Data Profiling, Monitoring Tools. 6. Implement internal solutions to handle all issues in the data, such as creating custom transformers or pre-ingestion logic. Skills: Python (ETL Scripts), PySpark, AWS Lambda, JSON Processing. 7. Maintain and use data pipelines and processes to ingest required data in Bidgely. Skills: AWS Data Pipeline, Apache Kafka, SQL. 8. In case of custom utility data formats, create custom data pipelines in Bidgely to support the ingestion process. Skills: Python, Apache Spark, AWS Glue. 9. On rare occasions, support utility data integration work by working with the utility’s Datalake/IT team to understand their data structure, data sources, and formats, and assist in extracting data from their source systems. Skills: Data Lake Architecture (Azure Data Lake, AWS Lake Formation), API Integration, Data Formats (Parquet, ORC). What You Get Perks <ul> <li>Growth Potential with a Startup: Seize the opportunity to grow with an innovative startup</li> <li>Collaborative Environment: Work with a passionate team united by the goal of a clean energy future</li> <li>Unique Tools: We provide all the tools you need to excel in your role</li> <li>Group Health Insurance, Internet/Telephone Reimbursement, Professional Development Allowance, Gratuity etc</li> <li>Mentorship Programs: Opportunity to learn and receive mentorship from industry experts</li> <li>Flexible Work Arrangements: Benefit from flexible working arrangements, Work anywhere from India</li> </ul> Diversity, Equity, Inclusion and Equal Opportunity Bidgely is an equal-opportunity employer. We are serious about and embrace diversity and equal opportunity. We are committed to building a team that represents a variety of backgrounds, perspectives, and skills to build a better future and a better workforce. Our hiring decisions are based on your skills, talent, and passion – not on your background, gender, race, age, or the quirky way you dance at office parties. Bidgely is an EVerify employer. </div>

Bidgely (which means "electricity" in Hindi) is a highly energetic and innovative startup working on something that has never been done before. They have developed ground-breaking analytics that can itemize home energy usage data to the appliance level without using any plug-level monitors. Now, they are setting out to deliver this technology to millions of households across the world and help save energy on a massive scale.

Senior/Lead Data Engineer

<div class="\&quot;job-descr"> Who We Are Bidgely (which means \"electricity\" in Hindi) is an AI-powered SaaS Company accelerating a clean energy future by enabling energy companies and consumers to make data-driven energy-related decisions. Ranked #7 in Applied AI on Fast Company’s list of Most Innovative Companies in the World, Bidgely is putting customers at the center of the clean energy future. What We Do Powered by our unique patented technology, Bidgely's UtilityAI™ Platform transforms multiple dimensions of customer data - such as energy consumption, demographics, and interactions into deeply accurate and actionable consumer energy insights. We leverage these insights to empower each customer with personalized recommendations tailored to their individual personality and lifestyle, usage attributes, behavioral patterns, purchase propensity and beyond. How We Do It From a distributed energy resources (DER) and grid edge perspective, Bidgely is advancing smart meter innovation with data-driven solutions for solar PVs, electric vehicle (EV) detection, EV behavioral load shifting and managed charging, energy theft, short-term load forecasting, grid analytics and time of use (TOU) rate designs. Bidgely’s UtilityAI™ energy analytics provides deep visibility into generation and consumption for better peak load shaping and grid planning and delivers targeted recommendations for new value-added products and services. For more information, please visit <a href="%5C%22https://www.google.com/url?q=https://www.bidgely.com/&amp;source=gmail&amp;sa=D&amp;sa=E%5C%22">www.bidgely.com</a> or the Bidgely blog at <a href="%5C%22https://www.google.com/url?q=http://bidgely.com/blog&amp;source=gmail&amp;sa=D&amp;sa=E%5C%22">bidgely.com/blog</a>. How You Fit In Responsibilities 1. Gather and assemble large, complex sets of data that meet non-functional and functional business requirements. Skills: SQL, Python, R, Data Modeling, Data Warehousing, AWS (S3, Athena). 2. Create new data pipelines or enhance existing pipelines to accommodate non-standard data formats from customers. Skills: ETL Tools (e.g., Apache NiFi, Talend), Python (Pandas, PySpark), AWS Glue, JSON, XML, YAML. 3. Identify, design, and implement internal process improvements, including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes. Skills: Apache Airflow, Terraform, Kubernetes, AWS Lambda, CI/CD pipelines, Docker. 4. Build and maintain required infrastructure for optimal extraction, transformation, and loading (ETL) of data from various data sources using AWS and SQL technologies. Skills: SQL, AWS Redshift, AWS RDS, EMR (Elastic MapReduce), Snowflake. 5. Use existing methods or develop new tools/methods to analyze the data and perform required data sanity validations to ensure completeness and accuracy as per technical and functional requirements. Skills: Python (NumPy, Pandas), Data Validation Tools, Tableau, Power BI. 6. Work with stakeholders including Customer Onboarding, Delivery, Product, and other functional teams, assisting them with any data-related technical or infrastructure-related issues. Skills: Stakeholder Communication, JIRA, Agile Methodologies. 7. Provide actionable insights into key data metrics (volumes, trends, outliers, etc.), highlight any challenges/improvements, and provide recommendations and solutions to relevant stakeholders. Skills: Data Analysis, Data Visualization Tools (Tableau, Looker), Advanced Excel. 8. Coordinate with the Technical Program Manager (TPM) to prioritize discovered issues in the Data Sanity Report and own utility communications. Skills: Project Management Tools, Reporting Tools, Clear Documentation Practices. Expectations from the Role: 1. Be the primary owner of the data sanity process internally. Skills: Data Quality Management, Python (Data Validation Libraries), SQL Auditing. 2. Run defined sanity checks/validations on utility data to ensure data accuracy and completeness. Skills: Python, SQL, QA Tools, AWS QuickSight. 3. Create the data sanity report using the established process and template. Skills: Report Automation Tools, Excel Macros, Python. 4. Provide actionable insights into key data metrics, highlighting any challenges/improvements in the data. Skills: Business Intelligence Tools (Tableau, Power BI), Statistical Analysis Tools. 5. Assess issues in the data as per the technical and functional requirements of the implementation and flag critical issues to the TPM. Skills: Root Cause Analysis, Data Profiling, Monitoring Tools. 6. Implement internal solutions to handle all issues in the data, such as creating custom transformers or pre-ingestion logic. Skills: Python (ETL Scripts), PySpark, AWS Lambda, JSON Processing. 7. Maintain and use data pipelines and processes to ingest required data in Bidgely. Skills: AWS Data Pipeline, Apache Kafka, SQL. 8. In case of custom utility data formats, create custom data pipelines in Bidgely to support the ingestion process. Skills: Python, Apache Spark, AWS Glue. 9. On rare occasions, support utility data integration work by working with the utility’s Datalake/IT team to understand their data structure, data sources, and formats, and assist in extracting data from their source systems. Skills: Data Lake Architecture (Azure Data Lake, AWS Lake Formation), API Integration, Data Formats (Parquet, ORC). What You Get Perks <ul> <li>Growth Potential with a Startup: Seize the opportunity to grow with an innovative startup</li> <li>Collaborative Environment: Work with a passionate team united by the goal of a clean energy future</li> <li>Unique Tools: We provide all the tools you need to excel in your role</li> <li>Group Health Insurance, Internet/Telephone Reimbursement, Professional Development Allowance, Gratuity etc</li> <li>Mentorship Programs: Opportunity to learn and receive mentorship from industry experts</li> <li>Flexible Work Arrangements: Benefit from flexible working arrangements, Work anywhere from India</li> </ul> Diversity, Equity, Inclusion and Equal Opportunity Bidgely is an equal-opportunity employer. We are serious about and embrace diversity and equal opportunity. We are committed to building a team that represents a variety of backgrounds, perspectives, and skills to build a better future and a better workforce. Our hiring decisions are based on your skills, talent, and passion – not on your background, gender, race, age, or the quirky way you dance at office parties. Bidgely is an EVerify employer. </div>

Senior/Lead Data Engineer

About the Job

About the Company

Bidgely

Similar Jobs

Senior Data Engineer

Senior Data Engineer

Staff Data Engineer

Staff Data Engineer

Data Architect

Data Architect