GCP Data Streaming Engineer - 3 months - Inside IR35 - Hybrid

Are you passionate about leveraging data to drive transformational change? Here's your chance to make a meaningful impact as a GCP Data Streaming Engineer with a renowned global consultancy. Join a market leading consultancy for an exhilarating 3-month contract (with prospects for extension) where you'll play a pivotal role in shaping the future of data streaming solutions.

As our GCP Data Streaming Engineer, you'll be at the forefront of harnessing the power of Google Cloud Platform (GCP) to design, develop, and implement cutting-edge data streaming solutions. Leveraging your expertise in GCP technologies, including Pub/Sub, Dataflow, and BigQuery.

Key Responsibilities:

• Develop Scalable Solutions: Lead the creation of scalable and dependable data streaming solutions on GCP using Apache Kafka and associated technologies.

• Optimize Kafka Setup: Customize Kafka brokers, topics, partitions, and replication to guarantee the highest performance and reliability of data streams.

• Configure Kafka Connectors: Apply your expertise to set up Kafka connectors for batch processing, managing both source and sink connectors to seamlessly integrate data.

• Python and Apache Beam Proficiency: Utilize Python and Apache Beam to craft tailored data processing logic and transformations within pipelines, enabling swift and effective data analysis.

• Ensure Security: Implement SSL/TLS encryption, SASL authentication, and ACL-based authorization to fortify Kafka clusters and communication channels, ensuring data integrity and privacy.

What you will Ideally Bring:

• Hands-On Kafka Configuration: Proven expertise in configuring Kafka connectors for batch processing, optimizing their number for improved performance.

• Python and DataFlow/Apache Beam Proficiency: Skilled in Python and DataFlow/Apache Beam, adept at developing custom data processing logic within pipelines

• Streaming Data Management: Demonstrated ability in handling streaming data, ensuring timely processing and Real Time analysis, employing various techniques like windowing and buffering.

• Secured Cloud Environment Experience: Experienced in deploying Kafka in secure cloud environments, implementing SSL/TLS encryption, SASL authentication, and ACL-based authorization.

• Kafka Configuration and Governance: Proficient in configuring Kafka brokers, managing security, and enforcing schema governance to ensure reliability, scalability, and compliance.

Contract Details:

• Duration: 3 months
• Day Rate: Up to £550 Per Day (All Inclusive)
• Location: Cardiff/Remote

GCP Data Streaming Engineer - 3 months - Inside IR35 - Hybrid