Tools › Aerodynamics › Aircraft Certification › Compliance Matrix Builder › Method

Compliance Matrix Builder: Method

Open the Compliance Matrix Builder tool

Compliance Checklists, Means of Compliance Codes and the Section Data

What the tool does

A certification plan for a new product or a design change lists the airworthiness requirements that apply, says how compliance with each will be shown and names the document that will show it. FAA Order 8110.4C (paragraph 2-3d) asks the plan for the proposed certification basis "including applicable regulation paragraphs and subparagraphs with amendment levels", for a description of how compliance will be shown "(ground test, flight test, analysis, similarity, or other acceptable means of compliance)" and for a list of the documentation to be submitted, and adds that this "can be accomplished using a compliance checklist addressing each section of the regulations applicable to the product". The tool drafts that checklist: it takes rows of section, means of compliance and document, looks every section number up in the current regulation, prints its heading and subpart, and reports what is missing or mistyped.

It is a bookkeeping aid. It does not decide which sections apply to a change, at which amendment level, or whether a means of compliance is acceptable; those are determinations of the applicant and the authority (14 CFR 21.17, 21.20 and 21.101 for the designation of the applicable regulations and the showing of compliance).

The section data

The tool carries the section numbers, section headings, subpart titles and appendix titles of 14 CFR Parts 23 (normal category airplanes), 25 (transport category airplanes), 27 (normal category rotorcraft), 29 (transport category rotorcraft), 33 (aircraft engines) and 35 (propellers) as published in the Electronic Code of Federal Regulations on the date printed with the results. Only the headings are carried, not the rule text; each section number in the results links to its current text on ecfr.gov. The Code of Federal Regulations is a work of the United States government.

The data are a snapshot. The eCFR is updated daily as amendments take effect, so a heading or a section may have changed since the data date, and the linked page shows the regulation as it stands on the day it is opened. The eCFR is an editorial compilation and not the official legal edition of the CFR.

Input

Compliance rows. One row per line: section | means of compliance | document | remarks. Cells are separated by vertical bars or by tabs, so a block copied from a spreadsheet can be pasted as it is. A line with neither is split at its first three commas, so that the remarks may contain commas but the document then may not. The section may be written 25.1309, ยง 25.1309, 14 CFR 25.1309, or with a paragraph, 25.1309(b); any text after it in the same cell (an amendment level such as "Amdt. 25-152") is printed under the section number. Appendices are written App F or Appendix F, and the two Special Federal Aviation Regulations of Part 25 as SFAR 13 and SFAR 109. Several codes in one cell are separated by commas, spaces, / or +; "MC2" and "MoC 2" are read as code 2 when the table defines 2. N/A in the code cell marks a section dispositioned as not applicable (give the reason in the remarks). The same section may appear on several rows, one per paragraph or per document. A header line and lines starting with # are skipped.

More sections. Sections can be added without a row in three ways: a list of numbers, a check box for every subpart of the selected Part (and one for its appendices), and keywords searched in the headings. A keyword term matches a heading that contains all of its words, parts of words included; terms separated by commas are alternatives. The search sees headings only: a requirement on flammability inside a section headed "Compartment interiors" is found by "interior", not by "flammab". Sections added this way are open until a compliance row addresses them.

Code table. One code per line: code | description | type of compliance. The default is described below; any short codes (digits or letters) can replace it.

Means of compliance codes

The default table is the list of ten codes that EASA publishes in Appendix A to AMC 21.A.15(b) of its acceptable means of compliance to Part 21, grouped by type of compliance: engineering evaluation (MC0 compliance statement, reference to design data, election of methods and factors, definitions; MC1 design review; MC2 calculation or analysis; MC3 safety assessment), tests (MC4 laboratory tests; MC5 ground tests on related products; MC6 flight tests; MC8 simulation), inspection (MC7 design inspection or audit) and equipment qualification (MC9), with the note that equipment qualification is a process that may include all the previous means of compliance at equipment level. The appendix also pairs the codes with the kinds of compliance document (design data and recorded statements, descriptions and drawings, substantiation reports, safety analyses, test programs, reports and interpretations, inspection or audit reports). The numbering is EASA material, not an FAA requirement: the FAA order speaks of ground test, flight test, analysis, similarity or other acceptable means and prescribes no codes. The descriptions in the default table are short forms of the EASA wording and are meant to be edited to the project's own definitions.

What the results show

Matrix. One row per compliance row, plus (optionally) one open row for every other chosen section, in regulation order or in the order pasted. The status of a row is "Assigned" when it has at least one code from the code table and a document; "Open: no document", "Open: no means of compliance" or "Open: not addressed" when something is missing; "Not applicable" for N/A; and "Check" when a code is not in the code table or the section is reserved in the current regulation.

Not found. Every entry that is not a section number of the selected Part on the data date is listed with the reason (no such section, a section of another Part, not readable as a number) and with the existing section numbers that are one typing slip away: one digit changed, dropped or added, or two neighboring digits swapped. The suggestions are numbers that exist, not a guess at what was meant.

Not addressed. The sections chosen by subpart, list or keyword that no row addresses with a code from the table or with N/A. Checking a whole subpart and reading this table is the quick way to see which of its sections the checklist has not yet dispositioned.

Counts. Rows and different sections under each code (a row with two codes counts under both), and for each subpart the number of sections in the Part, in the matrix, addressed and open. Reserved sections are left out of the counts.

What it assumes

That the certification basis is written against the section numbering of the selected Part as it stands on the data date. That one row is one showing: a section with several paragraphs shown by different means takes one row per paragraph. That a section is addressed once any of its rows carries a recognized code or N/A; the tool cannot tell whether every paragraph of the section has been covered. Limits: 400 compliance rows, 400 list entries, 40 codes, 300 characters per cell.

When it misleads

Earlier amendment levels. A design change is often certified to the amendment levels of the original type certificate or to a mix settled under 14 CFR 21.101. Sections that were later removed, renumbered or reserved are reported as not found or reserved although they belong to that basis, and the heading printed for a section is today's, which may differ from the heading and content at the amendment in the basis. Part 23 is the plain case: since Amendment 23-64 its sections are numbered 23.2000 to 23.2620 (three older numbers remain), and an airplane certified to an earlier amendment has a basis in the old numbering (23.561, 23.1309 and so on) that this data set does not contain.

What is outside the six Parts. Special conditions, exemptions, equivalent level of safety findings, noise and emissions requirements (Parts 34 and 36), operating rules that drive equipment, and the airworthiness codes of other authorities (the EASA Certification Specifications use similar numbers but are a different text) are not in the data. They can be carried in the list only as remarks.

Headings are not requirements. The keyword search and the heading column are navigation. A complete checklist comes from reading the rule text, the certification basis on the type certificate data sheet and the guidance for the change, not from the headings.

Typing-slip suggestions. A mistyped number that happens to be another existing section (25.1301 typed as 25.1310) is not caught; reading the heading column against the intent is the check for that.