Software Engineer

Job Title: Software Engineer

Job Description

(Corporate Solutions General Inc has multiple openings in Houston, TX) Software Engineer: Work with distributed computing platforms/cloud technologies such as Big Data and associated technologies such as Operationalization and performance tuning of Spark jobs on a large volume of data. Develop python scripts for automation and to generate the output response.

Develop code to analyze the customer data by building models on the data. Design and optimize queries in BigQuery so that it reduces data processing time. Migrating the current existing process into GCP cloud for better performance.

Analyze the spark jobs and logs if there is any job failure and fix the code accordingly including optimization. Build scalable data pipelines using BigQuery and GCP. Utilize GCP, Big query, Dataproc, Airflow, SQL, Python, Spark.

Will work in various unanticipated locations throughout the U.S. Requires Masters in Computer Science, Engineering, or related & 2 years experience. 2 years must include experience with GCP, Big query, Dataproc, Airflow, SQL, Python, and Spark.