Sr Data Engineer - AWS
at InfoVision Inc.
in
Addison,
Texas
Posted in Other about 4 hours ago.
Type: full-time
Job Description:
- 12+ years of IT experience.
- Experience or knowledge of relational SQL and NoSQL databases, including Postgres and Cassandra.
- Strong understanding of in-memory processing and data formats (Avro, Parquet, Json etc.)
- Experience in AWS cloud services: EC2, MSK, S3, RDS, SNS, SQS
- Experience in stream-processing systems: i.e., Storm, Spark-Structured-Streaming, Kafka consumers.
- Experience in migrating the project.
- Experience in object-oriented/object function scripting languages: i.e., Python, Java, Scala, R, SQL.
- Experience in data pipeline and workflow management tools: i.e., AWS Data Pipeline, Apache Airflow, Argo.
- Experience in big data tools: i.e., Hadoop, Spark, Kafka.
- Experience or knowledge of software engineering tools/practices: i.e., Github, VSCode, CI/CD
- Hands-on experience in designing and maintaining data schema life-cycles.