This role is part of an initiative to build a real-time data pipeline for processing front-office markets chat data. The system will ingest unstructured messages from trading and sales desks, invoke NLP Engine APIs to extract intent and entities, and transform the results into structured objects. These outputs will power downstream use cases such as trade analytics, trade processing, pricing, risk management, and compliance monitoring. In addition to real-time capabilities, the initiative will also encompass batch processing using big data technologies like Apache Spark to handle large historical datasets, enable complex analytical workloads, and generate aggregated reports. The solution leverages Java, Spring Boot, Elasticsearch, Oracle, Kafka, Apache Spark, and caching frameworks to ensure scalability, low latency, high reliability, and efficient processing of both real-time and historical data in mission-critical trading environments.
Position OverviewWe are seeking an experienced Senior Java Developer to design and build scalable, high-performance applications for real-time and batch data processing. The ideal candidate will have strong expertise in Java, Spring Boot, Elasticsearch, Oracle, Kafka, Apache Spark, and caching frameworks (Redis or similar). In addition, the candidate should be comfortable leveraging Generative AI coding tools ( GitHub Copilot and Devin AI) to accelerate development, improve productivity, and ensure code quality. You will play a key role in architecting and developing robust solutions, and collaborating with business and technology teams to ensure system efficiency and reliability.Responsibilities:
- Design, develop, and maintain high-performance Java applications for processing front-office chat data in real time.
- Design, develop, and optimize batch processing jobs using Apache Spark for large-scale data transformation and analysis.
- Implement config-driven, Spring-based components for data ingestion, transformation, and enrichment.
- Develop and optimize REST APIs for integration with NLP engines, internal systems, and external applications.
- Integrate and manage Apache Kafka for high-throughput, low-latency event streaming.
- Utilize Elasticsearch for efficient indexing and querying of large chat-derived datasets.
- Write optimized Oracle SQL/PLSQL for configuration management.
- Leverage continuous integration pipelines to streamline development and deployment.
- Use Gen AI development tools (Copilot and DevinAI) to write, review, and optimize code efficiently.
- Collaborate with business analysts, product team and developers to ensure system reliability, scalability, and alignment with requirements
- 6-10 years of professional experience in Java application development.
- Expertise in Spring Boot and microservices architecture.
- Strong experience with Elasticsearch (indexing, queries, aggregations).
- Hands-on experience with Apache Kafka (publish/subscribe, streams, scalability).
- Proficiency in Oracle Database (SQL, PL/SQL, optimization).
- Extensive experience with Apache Spark for batch processing, including Spark SQL.
- Experience with big data ecosystems and cloud-based data platforms (e.g., Hadoop, Data Lakes, Snowflake, Databricks) is highly desirable.
- Experience with caching frameworks (Redis or equivalent).
- Ability to effectively leverage Gen AI coding assistants for improved development productivity.
- Knowledge of real-time data processing and large-scale batch processing and data pipeline design.
- Familiarity with NLP APIs and integrating external ML/AI services is a plus.
- Understanding of distributed systems, concurrency, and performance tuning.
Education
• Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.
------------------------------------------------------
Job Family Group:
Technology------------------------------------------------------
Job Family:
Applications Development------------------------------------------------------
Time Type:
Full time------------------------------------------------------
Primary Location Full Time Salary Range:
$120,800.00 - $170,800.00------------------------------------------------------
Most Relevant Skills
Please see the requirements listed above.------------------------------------------------------
Other Relevant Skills
For complementary skills, please see above and/or contact the recruiter.------------------------------------------------------
Automated Processing and AI
We use automated processing, including artificial intelligence, for our legitimate business interests (or our reasonable and appropriate business purposes) to identify and align the candidate's skills and abilities with a specific job opening. Additionally, if you so choose, or consent, we can match your skills and abilities to other suitable roles at Citi.
Importantly, all our hiring processes and decisions, including determining your suitability for a role, are conducted, checked, and decided by individuals. Our automated processing and AI do not involve relying on automatic or autonomous decision-making. Please refer to any Jurisdictional Considerations, with specific provisions for your country (where relevant) for further details.
------------------------------------------------------
This job opening is for an existing job vacancy.
------------------------------------------------------
Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.
If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.
View Citi’s EEO Policy Statement and the Know Your Rights poster.
