Data Engineering

What does the Data Engineering career field do?

Data engineering personnel can perform three primary work roles: Knowledge Management, Data Operations and Software Engineer in support of mission requirements. The data operations role involves designing, developing, and modifying AI applications, tools, and/or other solutions to enable successful accomplishment of mission objectives. This role also involves building, managing, and operationalizing data pipelines. The software engineering role encompasses a wide range of responsibilities, including supervising and performing as a software analyst, coder, tester, and manager in the design, development, maintenance, testing, configuration management, and documentation of application software systems, client-server, and web-enabled software and relational database systems critical to warfighting capabilities. DCWF work roles associated with this specialty will be listed in the Career Field Education and Training Plan (CFETP).

Duties and responsibilities

• Data Engineering-1D7X4 Responsible for the operationalized knowledge management and administration of processes and tools that enable the organization to identify, document, and access intellectual capital and information. Designs, develops, and modifies SharePoint policy, site structure, objects, and storage requirements to enable successful accomplishment of mission objectives Designs, builds, tests, and deploys web applications using Hypertext Markup Language (HTML), and Cascading Style Sheets (CSS). Customizes content, creates workflows, and manages accounts to meet the knowledge engineering of a business or mission. Collaborates with stakeholders to elicit user requirements. Ensures intellectual capital and relevant information is maintained throughout the information lifecycle, delivers shared understanding and increased organizational performance and decision-making capabilities to support the mission.
• Data Operations-1D7X4D Designs, develops, and modifies AI applications, tools, and/or other solutions to enable successful accomplishment of mission objectives Designs a system’s data models, data flow, interfaces, and infrastructure to meet the information requirements of a business or mission. Holds responsibility for developing, promoting, and overseeing implementation of data as an asset and the establishment and enforcement of data-related strategies, policies, standards, processes, and governance. Builds, manages, and operationalizes data pipelines. Collaborating with data scientists, analysts, and other stakeholders to ensure that data is used effectively to support the mission. Develops and maintains plans, policies, and processes for data management, data governance, security, quality, accessibility, use, and disposal.
• Software Engineering – 1D7X4P Develops standardized tools and interfaces in accordance with Department of the Air Force Network Operations guidance to transform raw data into actionable C2 information. Develops and implements policy to enable effective information discovery, indexing, storage, life-cycle management, retrieval, and sharing in a collaborative enterprise information environment. Harnesses capabilities of systems designed to collect, store, retrieve, process, and display data to ensure information dominance. Ensures compliance with DoD directives and standards for security and interoperability. Protects operating systems, application software, files, and databases from unauthorized access to sensitive information, or misuse of communication-computer resources. Determines, analyzes, and develops requirements for software systems through interpreting standards, specifications, and user needs as a system analyst. Determines, designs, and develops data requirements, database structure, process flow, systematic procedures, algorithms, and file structures to implement and maintain software systems using software engineering techniques. Works with systems using software methodologies such as distributed processing, systems networking, advanced information storage and retrieval, and management techniques. Determines and recommends the most reasonable approach in designing new systems or modifying existing systems. Develops and maintains system specifications. Conducts and participates in system reviews and technical interchanges. Selects appropriate software development tools. Explores commercial off-the-shelf options to satisfy user requirements. Translates system specifications and requirements into program code and database structures, implements designed functionality as software coders. Analyzes output products and debugs source code to isolate and correct errors in program logic, syntax, and data entry, and to ensure accuracy and efficiency. Conducts code reviews and unit-level testing. Develops and maintains unit-level test plans. Arranges test data and routines. Modifies existing programs to correct program errors or modifies existing functionality or interface. Prepares system graphical descriptions, standard language statements, workload data, and presents and proposes cost. Develops and maintains documentation such as program maintenance manuals and operational guides. Designs, develops, maintains, and executes test plans for formal qualification testing, system integration testing, regression testing and verification, validation, and acceptance testing as software testers. Conducts test events. Analyzes software system requirement documents. Develops and maintains test data. Performs analysis of test data, determines test results and develops test reports. Makes recommendations to release authorities concerning verifiability, validity, conformance, and interoperability of software systems. Designs, develops, maintains, and executes processes to manage software or database components, specifications, test plans, procedures and results, and revision history applicable to a software system to ensure systems in use meet user requirements as software configuration managers. Controls software components at all times to ensure availability and stability of documented baselines. Prepares and manages processes for reporting deficiencies and requesting changes to software components or systems. Manages change packages through analysis and development efforts ensuring testing is performed and documentation is created or updated as required. Conducts reviews of proposed change packages by the user community and control authorities. Prioritizes deficiency reports and change requests using guidance from the user community and control authorities. Prepares and maintains software system baseline documentation and procedures. Prepares, packages, and documents deliverable products. As software project manager, interacts with and provides oversight for software system developers and maintainers. Develops and prepares system requirements and proposals. Analyzes requests for information. Prepares documentation of proposal specifications and programs. Organizes system study teams and conducts briefings. Conducts and participates in design reviews and technical interchanges between developers and user representatives. Plans, conducts and reports on the results of system acceptance tests. Manages or participates in contract management, software quality assurance, or quality assurance evaluation process.

Specialty qualifications

Data Engineering – 1D7X4

• Knowledge. Knowledge of the following is mandatory. Basics of Networking Fundamentals, Client Systems, Switching and Routing, Servers, and Cybersecurity, Knowledge Management, SharePoint, Hypertext Markup Language (HTML), Cascading Style Sheets (CSS), and Cyber Operations.
• Education. For entry into this specialty, completion of high school or general education development equivalency is mandatory. Additional courses in computer software, computer science, information technology, and data science are desirable. Any data science or IT certifications are desirable.
• Training. For award of the AFSC 1D734, completion of the Knowledge Operations initials skills course is mandatory.
• 1D754. Qualification in and possession of AFSC 1D734. Experience performing Knowledge Management functions such as SharePoint, HTML, CSS, and Cyber Operations.
• 1D774. Qualification and possession of AFSC 1D754. Experience performing or supervising one of the functions of Knowledge Management, SharePoint, HTML, CSS, and Cyber Operations to enable successful accomplishment of mission directives.
• Other. The following are mandatory as indicated.
• See attachment 4 for additional entry requirements.
• For award and retention of this AFSC:
• Must maintain local network access IAW AFI 17-130, Cybersecurity Program Management, and DAFMAN 17-1301, Computer Security.
• Specialty requires routine access to Secret material or similar environment.
• Must obtain or meet DoD Cyber Workforce qualifications based on approved cyberspace requirements applicable for cyberspace tasks required for any position held IAW DoDM 8140.03, Cyberspace Workforce Qualification and Management Program, and DAFMAN 17-1305, DAF Cyberspace Workforce Management Program.
• Completion of a background investigation according to DoDM 5200.01 - DAFMAN 16-1405, Personnel Security Program Management, is mandatory.
• Must maintain & sustain highest security clearance level received up to Top Secret (Tier 5) or based on current position requirements.

Data Operations – 1D7X4D

Knowledge. Knowledge of the following is mandatory. Data administration, data standardization, data mining, data warehousing, query languages (e.g., SQL), database access application programming interfaces (e.g., Java Database Connectivity [JDBC]), national and international laws and regulations pertaining to data, cybersecurity principles, cyber threats and vulnerabilities, using tools to explore data (e.g., Hadoop, Java, Python, SQL, Hive, PIG), cloud computing models (e.g., software as a service, infrastructure as a service, and platform as a service), cloud computing deployment models in various environments, data operations processes and best practices, data security roles and responsibilities, organizational mission processes, Personally Identifiable Information (PII) data security standards, Personal Health Information (PHI) data security standards, container orchestration and resource management platforms, DoD AI ethical principles, AI solution integration with cloud or cloud IT infrastructure, automate the integration of AI/machine learning-enabled software to the DoD.

• Education. For entry into this specialty, completion of high school or general educational development equivalency is mandatory. Additional courses in computer software, computer science, information technology, and data science are desirable. Any data science or IT certifications are desirable.
• Training. For award of the AFSC 1D734D, completion of a Data Operations initial skills course is mandatory.
• 1D754D. Qualification in and possession of AFSC 1D734D. Experience performing data operations functions such as designing, developing, and modifying AI applications, tools, and/or other solutions to enable successful accomplishment of mission objectives.
• 1D774D. Qualification in and possession of AFSC 1D754D. Experience performing or supervising one of the functions of designing, developing, and modifying AI applications, tools, and/or other solutions to enable successful accomplishment of mission objectives.
• Other: The following are mandatory as indicated.
• See attachment 4 for additional entry requirements.
• For award and retention of this AFSC:
• Must maintain local network access IAW AFI 17-130, Cybersecurity Program Management, and DAFMAN 17-1301, Computer Security.
• Must obtain or meet DoD Cyber Workforce qualifications based on approved cyberspace requirements applicable for cyberspace tasks required for any position held IAW DoDM 8140.03, Cyberspace Workforce Qualification and Management Program, and DAFMAN 17-1305, DAF Cyberspace Workforce Management Program.
• Specialty requires routine access to Secret material or similar environment.
• Completion of a current Tier 3 (T3) background investigation according to AFMAN 16-1405, Personnel Security Program Management, is mandatory.
• Must maintain & sustain highest security clearance level received up to Top Secret (Tier 5), or based on current position requirements.

Software Engineering – 1D7X4P

• Knowledge: Knowledge of the following is mandatory. System capabilities, limitations, and programming logic; techniques and procedures of systems analysis and design; related information processing devices and systems; C-CS; software methodologies; methods of editing input and output data; configuration management techniques; security practices; customer relations; application of mathematical and analytical concepts to process problems within a C-CS; and computer program editing and testing techniques.
• Education. For entry into this specialty, completion of high school or general educational development equivalency is mandatory. Additional courses in algebra, geometry, computer science and computer programming are desirable. Any network or computing commercial certification is desirable.
• Training. For award of the AFSC 1D734P, completion of a Computer Systems Programming initial skills course is mandatory.
• Experience. The following experience is mandatory for award of the AFSC indicated.
• 1D754P. Qualification in and possession of AFSC 1D734P. Experience performing programming functions such as designing, coding, testing, or documenting software.
• 1D774P. Qualification in and possession of AFSC 1D754P. Experience performing or supervising one of the functions of programming, such as preparing system requirements, developing high-level or detailed designs, translating designs into code, testing, configuration management, or project management.
• Other. The following are mandatory as indicated.
• For entry into this specialty.
• See attachment 4 for additional entry requirements.
• For award and retention of this AFSC:
• Must maintain local network access IAW AFI 17-130, Cybersecurity Program Management and DAFMAN17-1301, Computer Security.
• Must obtain or meet DoD Cyber Workforce qualifications based on approved cyberspace requirements applicable for cyberspace tasks required for any position held IAW DoDM 8140.03, Cyberspace Workforce Qualification and Management Program, and DAFMAN 17-1305, DAF Cyberspace Workforce Management Program.
• Specialty requires routine access to Top Secret material or similar environment.
• Completion of a current Tier 5 (T5) background investigation according to AFMAN 16-1405, Personnel Security Program Management, is mandatory.
• Must maintain a Top-Secret clearance (Tier-5) for retention of this AFSC. NOTE: Award of the 3-skill level without a completed investigation is authorized provided minimum of interim Tier 5 (Top-Secret) clearance has been granted according to DoDM 5200.01 - AFMAN 16-1405.