LICENSE STRUCTURE  

1. Can an inspector work only at a test and a test and repair station?

Yes, the new license structure allows for more flexibility. 

2. What Classes Are required to become an Inspector? 

There are two classes an inspector needs to take, providing he does not meet certain experience requirements. They are inspector level 1 and inspector level 2. The applicant may bypass Level 1 if they possess ASE A6, A8, and L1, or an associate’s degree in automotive plus 1-year automotive experience, or completed a 720-hour automotive training program with 280-course hours in the area of engine performance plus 1-year experience, or completion of the BAR specified Diagnostic and repair training plus two years automotive experience. 

3. How many licenses are there now?

There are two licenses, “Inspector and “Repair.” The Applicant may choose any one or both.

4. What classes are needed for repair?

For the Repair license, the technician may qualify if he meets any of the following four requirements: Possess ASE A6, A8, and L1, or an associate’s degree in automotive plus one year of automotive experience; completed a 720-hour automotive training program with 280-course hours in the area of engine performance; or completion of the BAR specified Diagnostic and repair training plus one year of automotive experience.

5. I already have my ASE A6, A8, and L1. What training is needed to get the test and repair license?

Minimal training is required. All that is needed is to complete the level 2 inspector training and take the state exam for both inspector and repair.

6. What is needed for a repair technician to maintain their license?

A repair technician must take a 16-hour update class and keep their ASE A6, A8, and L1 or BAR Specified Diagnostic and Repair current.

7. What is required to keep an inspector license current?

Inspectors must take a 4-hour update class to keep their licenses current.

8. Can I still take the ASE alternatives A6, A8, and L1?

Yes. However, after August 2014, the ASE alternatives are no longer available, and any applicant renewing a license must show proof of current ASE A6, A8, and L1 or the New BAR specified diagnostic training.

9. Can Smog Inspectors perform repairs?

Smog Inspectors cannot perform vehicle repairs related to smog check failures, but other repairs are permitted.

10. May a repair-only technician perform smog Inspections?

No. They are permitted to repair the failed vehicle but not do the inspection. They are two separate licenses, and each of them has separate qualifications.

11. How much does it cost to apply for a smog license?

There is a 20-dollar application fee from the BAR and a 65-dollar fee to take the exam..

1. GENERAL STAR QUESTIONS

1.1 How can station and inspectors find their STAR Program scores?

Visit the STAR Web page to see the scores.

1.2 When did the STAR Program begin?

The STAR Program began on January 1, 2013.

1.3 How long does a station have to be in business before it can become STAR-certified?

Stations may apply for STAR certification once they have enough data on the short-term measures from the previous calendar quarter.

1.4 How often are STAR scores updated?

The STAR performance measures reported on the BAR Web page can be divided into two groups. The first is the short-term measures, which include Test Deviations, Similar Vehicle Failure Rate (SVFR), and Improper Gear Selection during the ASM test. The second group comprises criteria associated with the Follow-up Pass Rate (FPR), a long-term performance measure. The short-term scores are updated every month. However, pass/fail decisions are made only on a calendar quarter basis. FPR scores, on the other hand, are calculated and updated on the Web page twice a year, in January and July.

1.5 Can station owners/managers use the BAR’s STAR website to determine an inspector’s STAR score?

STAR scores are provided for all stations and inspectors licensed to perform Smog Check inspections. Stations looking to enter an inspector into their station analyzer(s) may choose to check an inspector’s FPR score since each inspector’s FPR score will directly affect the station’s STAR certification. Station owners can check an inspector’s performance on the other STAR measures the station must meet to ensure that the inspector is less prone to affect a station’s STAR scores adversely.

Inspectors also may want to check the STAR scores of stations where they are currently or plan to be entered into the analyzer(s).

1.6 Once a station’s STAR certification is invalidated, how long before it is eligible to reapply to the STAR Program?

Stations with their STAR certification invalidated by BAR are not eligible to apply for the STAR Program for at least six months. A station or any of its inspectors cannot have received a citation within the last year or been the subject of a BAR administrative action within the last three years. Both are based on the effective date of the citation or administrative action, not the date of issuance.

1.7 If a STAR-certified station relocates to a new address, will they have to reapply to the STAR Program?

No, a change of address will not affect a station’s STAR certification. July 2013 Page 5

1.8 How will motorists know which stations are STAR-certified?

The most convenient and up-to-date way for motorists to identify stations that can inspect their vehicles is on the BAR Web page. The page contains a Smog Check station locator tool to help motorists find stations in their area. Visit the Smog Check station locator tool to find a station.

1.9 Can motorists use BAR’s STAR website to find stations and inspectors more likely to perform low-quality inspections?

BAR is aware that some motorists may try to use the STAR website to identify lower-performing Smog Check stations that are more likely to perform an improper Smog Check inspection. To reduce the likelihood of this happening, the STAR Web page has been designed to require that the user know the station or inspector's license number to search. While this will not prevent unintended use of the STAR Web page, it will make it less convenient and, hopefully, less common.

1.10 How are the standards for the STAR performance measures generated?

Standards for the STAR performance measures are set by evaluating stations and inspectors against other stations and inspectors throughout the Smog Check program. To explain how each STAR performance measure is assessed, click on the title of any of the performance measures shown on the report card feature of the STAR Web page.

1.11 What source of data is used to generate the STAR performance scores?

All STAR performance scores are calculated using data collected by the Smog Check inspection equipment during a vehicle inspection.

1.12 My Smog Check station offers a “free retest” to consumers who fail their initial Smog Check at my station. Will this policy affect my STAR certification, and if so, how?

It could. Stations offering “free retests” must provide two inspections for the price of one whenever a vehicle fails its initial inspection. This can cut profit, especially at busy stations where shop owners must forgo additional work to perform the retests. A station’s eligibility for the STAR Program could be jeopardized when stations and inspectors perform incomplete or inaccurate Smog Check inspections to avoid providing “free retests.”

1.13 I own a Smog Check station in a Change-of-Ownership Area. Can I still become a STAR-certified station even though most vehicles my station inspects are not in a biennial inspection (Enhanced or Basic) area?

Yes. Stations located in a Change of Ownership Area will still be able to participate in the STAR Program. However, one of the rewards of the Program – the ability to certify directed and gross-polluting vehicles – may not have as much value to a station July 2013 Page 6

Located outside an Enhanced Area or even a Basic Area, the station and inspector scores from Change of Ownership Areas will be posted on the STAR Web page along with scores from the state's Enhanced and Basic Areas.

1.14 Are there any plans to change the “directed vehicles” percentage?

There are no plans to change the percentage of “directed vehicles.”

2. STATION TYPE RULES

2.1 What station types are in the Smog Check Program?

Smog Check stations can be licensed as either Test-Only, Test-and-Repair, or Repair-Only stations. Both Test-Only and Test-and-Repair stations may apply for STAR certification. As a result, there are four possible station types allowed to inspect vehicles:

STAR Test-Only – cannot repair vehicles but can inspect and certify all vehicles, including directed and gross-polluting vehicles;

STAR Test-and-Repair – can repair vehicles and can certify directed vehicles and gross-polluting vehicles; also must provide repair assistance services under BAR’s Consumer Assistance Program;

Test-Only (non-STAR certified) – can inspect vehicles that are not directed or gross-polluting vehicles, including cars changing ownership;

Test-and-Repair (non-STAR certified): This service can repair, inspect, and certify vehicles that are not directed or grossly polluting, including vehicles changing ownership.

In addition, there is now a Repair-Only station license for the Smog Check Program. However, since these stations are licensed only to perform repairs, not Smog Check inspections, they are not eligible for the STAR Program.

2.2 If I own a Test-Only station but choose not to participate in the STAR Program, can I still inspect “directed vehicles”?

No, only STAR-certified stations may inspect directed and gross-polluting vehicles.

2.3 Can Test-Only stations apply for STAR certification?

Yes, the STAR Program does not include repair-based performance measures that would prevent Test-Only stations from applying for STAR certification.

2.4 Can a Test-Only station apply for certification as a STAR Test-and-Repair station?

Yes, since there are no repair-based performance measures in the STAR Program. A Test-Only station can change its license to a Test-and-Repair station and apply for the STAR Program. July 2013 Page 7

2.5 Can I own a Test-Only station and a Test-and-Repair station, regardless of whether or not the stations are STAR-certified?

Yes, but with some restrictions. Suppose the two stations have a common financial interest and are located adjacent to each other or in the same business park, strip mall, or industrial complex. In that case, one station cannot be licensed as a Test-Only station, and the other can be licensed as a test-and-repair station. Instead, they must both be licensed as a Test-and-Repair or Test-Only station.

2.6 How does the STAR Program differ from the former Gold Shield Program?

The Gold Shield program allowed Test-and-Repair stations to certify directed and gross-polluting vehicles. Gold Shield stations were responsible for performing state-funded repairs under the Consumer Assistance Program (CAP). The performance measures for the former Gold Shield Program were primarily based on repair data.

The STAR Program is a certification program for both Test-Only and Test-and-Repair stations that wish to certify directed and gross-polluting vehicles. By law, performance measures for the STAR Program must be the same for both Test-Only stations and Test-and-Repair stations; therefore, there are no standards based on the number or quality of repairs. STAR Test-and-Repair stations also must provide repair assistance services under the BAR’s Consumer Assistance Program (CAP).

3. SHORT-TERM PERFORMANCE MEASURES

3.1 Where can I get more information on the performance measures of the STAR Program?

The STAR Web page has detailed information on each of the performance measures that can be accessed by clicking various links within the STAR report. Each performance measure links to a definition of that performance measure.

3.2 Is repair effectiveness evaluated for STAR certification of Test-and-Repair stations?

Repair effectiveness is not evaluated as part of the STAR Program. AB 2289 (Eng., Chapter 258, Statutes of 2010) explicitly precludes BAR from using different performance measures for both Test-Only and Test-and-Repair stations in the STAR Program. Since Test-Only stations do not perform repairs, we cannot use repair effectiveness as a performance measure for any station type in the STAR Program.

3.3 If an inspector at the station I own gets a citation, is my station out of the STAR program?

A STAR station cannot have an inspector entered into its analyzer(s) who received a citation within the last year or had an administrative action taken against their license July 2013, Page 8

Within the last three years. Both are based on the effective date of the citation or administrative action and not the date of issuance. This is true even if the inspector received a citation or had administrative action taken against their license while working at another station.

3.4 Why is it important to use updated Smog Check reference materials?

Stations and inspectors should always use up-to-date reference materials when performing a Smog Check inspection, as required by BAR regulations (Sections 3340.16(a) (6) and (7)). This would include the Smog Check Manual and Emission Control System application guides. Failure to use up-to-date material can result in improper inspection procedures that may lead to stations failing to meet the STAR performance standards.

3.5 Can one isolated mistake on a Smog Check inspection force me out of the STAR Program?

It depends on the nature of the mistake. A mistake that leads to a citation or administrative action is grounds for and can invalidate a station’s STAR certification. In contrast, it generally takes several repeated inspection errors before a station fails to meet any STAR performance measures based on Smog Check inspection data.

3.6 If I replace a failing fuel cap in the middle of the inspection and then pass the vehicle, will that hurt my Similar Vehicle Failure Rate (SVFR)?

Smog Check inspectors can replace leaking fuel caps mid-inspection to avoid having to fail the vehicle when the sole reason for the Smog Check failure is the fuel cap. When this occurs, and the inspector indicates that the fuel cap was replaced during the test, the SVFR performance measure will treat the inspection as though the fuel cap failed the leak-down portion of the inspection. Thus, while the official result for the inspection was a pass, replacing the cap mid-inspection will not hurt a station’s SVFR.

3.7 What should I do if I think an incident for one of the short-term measures is incorrect?

The STAR page provides information related to vehicle testability and some aspects of the smog check inspection based on results from the industry for similar vehicles. However, BAR is providing stations and inspectors an opportunity to challenge an incident in situations where the STAR page indicates that a station or inspector failed to perform a specific element of the Smog Check inspection, and the station or inspector can prove that the test was inappropriate.

For example, suppose an incident is shown for your station or an inspector not having performed a timing test on a vehicle when most other stations or inspectors did a test on similar cars, and the car did not have adjustable timing. In that case, the specific incident for that vehicle can be challenged.

Station owners who feel that an incident is incorrect and keeping the station from qualifying for the STAR Program should apply for STAR July 2013 Page 9 certification. If the BAR’s Licensing Unit denies the application, specific instructions will be provided detailing the process for re-evaluating the denial. Note that station incidents will be considered if they keep a station from passing the STAR performance measures.

Inspectors who challenge an incident can email BAR’s Help Desk (bar.industryhelpdesk@dca.ca.gov). Inspector incidents should only be challenged if they result in a specific performance measure being highlighted in red on the inspector’s report card.

Challenges to specific incidences, either by the inspector through BAR’s Help Desk or by the station while requesting a re-evaluation of an application denial, will only be considered if the challenge is specific and supported with appropriate documentation. For example:

“The STAR Performance Report Card indicates that I should have performed a timing test on a [model year, make, model, certificate number issued] vehicle. However, as indicated in [provide a detailed reference for your information such as ALLDATA or Motor, including links or page numbers], this vehicle does not have adjustable timing and, therefore, should not have a timing test.”

BAR encourages the industry to submit well-researched information regarding vehicle testability, which will be used to refine future analyses under the STAR Program. For this reason, requests to challenge an incident will not be considered if the basis for the challenge has not been researched and supported with specific documentation.

3.8 How does the STAR Program account for different socio-economic areas where stations operate?

The STAR Program does not consider geographic factors when identifying vehicle owner means or affluence. Instead, the STAR Program uses the vehicles by comparing vehicles with a similar model year, make, model, engine displacement, mileage, etc. The reasoning for this analysis is that the characteristics of the cars, regardless of where they are registered, are better indicators of consumer behavior, and one’s financial means is the address at which one resides. For instance, the average owners of the 1991 Saturn Coupes with 150,000 miles will likely have much more in common than people who live within a mile of each other. In other words, the vehicles themselves are the best information available to help correct for differences in station demographics. For this reason, all of the STAR performance measures consider the specific vehicles inspected by each station and compare them to similar vehicles inspected statewide. July 2013 Page 10

Max Readiness Monitors

3.9 I can’t control when motorists reset their computers before a Smog Check. Won’t this affect my Test Deviation result for maximum readiness monitors?

While it is true that inspectors often cannot control when motorists reset computers before an initial inspection, they should not recommend or provide this procedure to motorists before an inspection. When considering large data samples, there is no reason to expect motorists to reset vehicles tested at one station at a rate greater than similar vehicles inspected at other stations. For this reason, the primary difference between stations will be behavioral. Stations that reset computers before inspection, or those that recommend the procedure for motorists, will tend to have higher monitor reset numbers.

When I repair a failing vehicle, I ensure all OBD II monitors have run before certifying it. Other stations, however, may follow different procedures. Will I be penalized for certifying repaired vehicles with unset readiness monitors on the Max Readiness Monitor test deviation?

No. The Max Readiness Monitor performance measure only considers the number of unset monitors, if any, for each vehicle during its initial inspection. An initial inspection is the first test done in a vehicle's inspection cycle, whether a pretest or an official Smog Check inspection. This performance measure does not consider retests after a vehicle fails an initial inspection.

Where a station’s STAR score could potentially be affected by certifying vehicles with unset readiness monitors, however, is through the Follow-up Pass Rate (FPR). Even though the offending OBD II monitor hasn’t yet run, vehicles with accredited underlying defects will tend to fail their initial inspection at a higher rate in the next inspection cycle. This will tend to drive down the FPR scores for stations and inspectors that previously certified these vehicles.

3.10 Should I pre-screen vehicles for unset readiness monitors to avoid a possible deviation?

The “Max Readiness Monitors” measure is intended to identify stations that reset the OBD II system to get vehicles through the inspection process without making necessary repairs before performing the initial test on cars for a given inspection cycle. An initial inspection may be an official inspection or a pretest. It is the first test performed on a vehicle in its current inspection cycle, which may be for biennial inspection, change-of-ownership, or initial registration. Stations routinely resetting computers to mask diagnostic trouble codes (DTCs) will tend to have an elevated percentage of vehicles undergoing an initial inspection with precisely the number of unset readiness monitors allowed to pass the OBD II portion of the Smog Check inspection. The same applies to stations certifying vehicles for third parties engaging in this practice. July 2013 Page 11 Stations are concerned that they may get a deviation for unset readiness monitors, either because they certify many vehicles for third parties or because already published scores show an issue at that station. They may want to prescreen OBD II systems for unset readiness monitors. Test-Only and Test-and-Repair stations may prescreen for OBD II readiness and have OBD II scanners available.

Incorrect Gear Selection

3.11 My BAR-97 emissions inspection system often has difficulty picking up a stable engine RPM signal for vehicles with distributor-less ignition systems (DIS). Will this affect my STAR score?

The one STAR performance measure that uses the engine RPM reading is “Incorrect Gear Selection.” For that measure, ASM test results accompanied by abnormally high RPM readings are flagged as having been shifted into the incorrect gear during an ASM test mode.

Typically, antenna-based RPM errors will not result in Incorrect Gear Selection incidents. Antenna-based errors typically drive the RPM low, not high, as the RPM reading often drops completely. Low readings will not cause Incorrect Gear Selection incidents. Furthermore, results for this measure are corrected for the specific vehicles inspected by each station. In other words, results for particular vehicles for which RPM readings are difficult to measure will be compared to results from similar vehicles. Thus, the performance standards will be appropriate based on the cars inspected by each station.

Still, BAR recommends that stations pull the RPM readings directly from the OBD II system whenever possible. For CAN vehicles, which often have DIS and for which original BAR-97 emissions inspection systems cannot communicate through the OBD II port, stations may want to consider purchasing the BAR-97 update. This will allow inspectors to collect RPM readings for CAN vehicles directly using the OBD II port.

3.12 For the Incorrect Gear Selection measure, will a station be penalized if any of the vehicles it inspects are equipped with non-factory-sized tires?

No, the Incorrect Gear Selection measure is pretty lenient and allows for some variation in tire size without identifying an inspection as being driven in the incorrect gear. The underlying question is whether or not inspectors can alter the Smog Check procedures to accommodate a vehicle equipped with tires so large or small that it cannot be tested within the correct RPM range in the specified gear. Smog Check inspectors are required to follow the procedures outlined in the Smog Check Manual. If the vehicle is tested “as is,” please note that it could affect the station’s performance on the Incorrect Gear Selection measure, which should be documented on the Vehicle Inspection Report. The station can also refer the vehicle to the Referee for inspection. July 2013 Page 12

3.13 Does the transmission type entered during an ASM inspection affect the Incorrect Gear Selection performance measure?

Yes. If an inspector enters a manual transmission vehicle into the EIS as an automatic transmission, the inspection will likely trigger a gear shift incident. This is because the measured RPM for a manual transmission vehicle tested in 2nd gear during the “2525” mode of the ASM test will often fall outside the allowable range for automatic transmission vehicles. This type of error will be apparent when looking at the individual incidents under the Incorrect Gear Selection performance measure because the RPM during the “2525” portion of the ASM test will be roughly two-thirds (2/3) higher than the RPM of the “5015” test mode. The way to correct this problem is to be sure to enter the correct transmission type for each vehicle receiving an ASM test into the EIS. Generally, BAR recommends carefully reviewing all vehicle data entered into the EIS before beginning the ASM test mode.

3.14 During an ASM test, which gear should vehicles with automatic transmissions be inspected when the “Drive” position is not identified on the car?

Some newer automatic transmission vehicles, especially those with more than four forward gears, may not have clearly labeled “drive” settings. When the “drive” setting is not identified on a vehicle, it should be driven in the gear selector’s default driving position. This means the position where the car automatically shifts through the forward gears during driving.

3.15 During an ASM test, in which performance mode should vehicles with user-selectable automatic transmission shift settings be driven?

Some automatic transmission vehicles have different performance modes or settings controlling the transmission shift points. These are typically the standard/economy mode or the sport/performance/tow mode. Shift points in the standard/economy setting usually occur at lower engine RPM than in the sport/performance/tow settings. During an ASM test, vehicles with user-selectable transmission performance settings should be placed in the economy/standard mode, resulting in lower engine RPM shift points.

3.16 How should the vehicle be inspected during an ASM test when equipped with a transmission that allows manual or automatic shifting?

Suppose a vehicle is equipped with a transmission designed to shift automatically. In that case, the vehicle shall be ASM tested in the mode allowing automatic shifting, even if the car has an option for manual shift operation. Cars that do not have a fully automatic setting shall be tested as a manual transmission, even if they do not have a manual clutch. July 2013 Page 13

4. FOLLOW-UP PASS RATE (FPR)

4.1 Can I participate in the STAR Program if I have an inspector entered into my analyzer with a low FPR score?

Suppose a station has an inspector entered into their analyzer with an FPR score that does not meet STAR standards. In that case, the station may have difficulty approving their application for the STAR Program. Additionally, a STAR-certified station may be in jeopardy of invalidating its STAR certification by the BAR for having an inspector entered into their analyzer with an unacceptable FPR score. The table shown at the following link will help to explain this process. FPR Table

4.2 If a STAR-certified station has an inspector entered into their analyzer whose FPR score drops too low (less than 0.1), will the station automatically be ineligible to certify directed and gross polluting vehicles?

Stations are subject to having their STAR certification invalidated any time an inspector entered into their analyzer does not meet the FPR score requirements. The invalidation process will include notification to the station and an opportunity to mitigate the issue or to appeal the proposed decision.

4.3 Is a station’s eligibility for the STAR Program based on the average FPR scores of all inspectors working there?

No, the scores of each inspector entered into the station’s analyzer(s) must meet the FPR criteria. Once a station is STAR certified, BAR considers any inspector entered into the station’s analyzer(s), even if that inspector has only been entered into the analyzer(s) for one day during the evaluation period.

Consider the following example: a station has five Smog Check inspectors entered into its analyzer(s), four of whom have perfect FPR scores of 1.0, and the fifth inspector has an FPR score of 0.0. This station would be denied STAR certification because one inspector has too low an FPR score. Once the low-scoring inspector is removed from the station's analyzer(s), it would be eligible to apply for the STAR program.

4.4 What are my options if I am a station owner and inspector with a low FPR score?

A station owner who is also an inspector with a low FPR score may do one of two things. One, the owner may choose not to have their station participate in the STAR Program at this time. Two, the owner may enter another inspector into the station’s analyzer(s) and remove all inspectors with low FPR scores. The owner/inspector with an FPR score below the STAR standards must improve their score to acceptable levels before they can be entered into the station’s analyzer(s) to participate in the STAR program.

4.5 How do stations or inspectors improve their FPR score?

FPR scores can be improved by ensuring accurate Smog Check inspections are performed according to the Manual. July 2013 Page 14

Specific behaviors that affect a station’s or inspector’s FPR score include:

Clean piping (i.e., passing a vehicle that is out of compliance with the tailpipe emissions standards by introducing a substitute clean exhaust sample through the emissions analyzer) Clean plugging (i.e., using a substitute source of OBD II data for a failing vehicle’s OBD II self-diagnostic test)Shifting vehicles into the incorrect gear during an ASM test Over-conditioning vehicles (i.e., racing the engine to get a vehicle’s catalytic converter hotter than would happen under normal operating conditions)Not identifying visual inspection failures Not identifying functional inspection failures (e.g., fuel cap, ignition timing, low-pressure fuel evaporative emissions) Entering incorrect vehicle parameters to generate more lenient emission standards or a lighter vehicle weight loading (to create less treadmill resistance) during an ASM test.

4.6 How long does it take to improve an FPR score?

The Follow-up Pass Rate considers how vehicles certified by each station or inspector perform in their next Smog Check inspection cycle. For this reason, it could take up to two years to refresh all the data generated by a station or inspector. Still, stations and inspectors can change their scores much sooner with the help of change-of-ownership inspections that can occur well short of the two years of a biennial inspection.4.7 how does the FPR differ from the SVFR? The SVFR compares the initial test failure rate for vehicles inspected at each station to that for similar vehicles statewide. The FPR is identical in concept. However, it measures whether the vehicles certified by each station or inspector in the last cycle pass in the current cycle at a higher or lower rate than expected compared to similar cars inspected throughout the state.

4.8 Is my station required to inspect poorly maintained vehicles?

No, stations are allowed to specialize in the type of vehicles they inspect and repair but must post the types of vehicles for which they offer services. Remember that the FPR is based on comparing similar vehicles and conditions to all the other stations statewide. Vehicles with known maintenance problems can be directed to the Referee for inspection.

4.9 I can’t control what happens to a vehicle after it leaves my shop. Won’t this affect my FPR score?

Stations and inspectors have little control over what motorists do to their vehicles once they leave their stations. For this reason, it would be incorrect to evaluate a particular station’s performance based on how one, or even a few, vehicles performed during the next Smog Check inspection. For example, some properly inspected vehicles with passing emissions levels will fall into disrepair before their next Smog Check inspection. Conversely, other improperly certified high-emitting vehicles may get fixed to run correctly in their next inspection cycle. For this reason, the FPR measure is calculated using large amounts of data. July 2013 Page 15 This way, similar events like those mentioned will tend to average out for all the stations and inspectors. Instead of the” one-of-a-kind” events, the trends associated with proper inspections versus improper inspections will determine the FPR scores.

4.10 If a customer refuses additional necessary repairs once the vehicle’s emissions marginally pass the Smog Check, will this affect my FPR score and STAR certification even though I recommended additional maintenance?

The STAR Program does not consider after-repair emissions levels in evaluating performance measures. Repair data doesn’t factor into the STAR Program evaluation at all. Still, the Follow-up Pass Rate (FPR) measure under the STAR Program does consider whether or not vehicles certified by each station and inspector pass at a higher or lower rate than average in the next inspection cycle compared to similar vehicles. Stations that habitually certify vehicles with incomplete repairs (e.g., masking a fuel system problem with a new catalytic converter) may notice a lower FPR score in the long term. Still, it is unlikely that this behavior alone would push the station’s or inspector’s FPR score to an unacceptable level. Stations and inspectors who want to improve their FPR score and become STAR-certified should primarily focus on performing accurate Smog Check inspections according to the Smog Check Manual. If this is done, the marginal vehicles needing additional repairs will be less of a factor in the overall FPR calculations.

4.11 If the FPR evaluates how vehicles previously certified by stations and inspectors perform in the current inspection cycle, how will new stations and inspectors be assessed under this performance measure?

Smog Check stations and inspectors with low inspection volumes, including newly licensed stations and inspectors, will not receive an FPR score. An FPR score will only be generated once a sufficient volume of follow-up inspections is performed on vehicles previously certified by that station or inspector. In most cases, a station or inspector without an FPR score will not be an issue determining a station’s eligibility for the STAR Program. The only time that an inspector with an FPR of “No Score” may be an issue is when a STAR-certified station has a low FPR score (less than 0.4). STAR stations with low FPR scores cannot have an inspector entered into their analyzer(s) with an FPR of “No Score.” Similarly, STAR-certified stations without FPR scores cannot have an inspector entered into their analyzer(s) with a low FPR score (less than 0.4). For more information on the various FPR rules for determining STAR Program eligibility, please visit the FPR Table link.

4.12 If an inspector goes on an extended leave due to a medical condition or other reason, what happens to their FPR score?

The FPR measures whether vehicles certified previously by each station or inspector are passing in the current inspection cycle at a higher rate than average. Vehicles previously certified by higher-performing stations and inspectors will tend to fail at a lower rate in the July 2013 Page 16 inspection cycle. For more information about the FPR, visit the STAR Report Card Terms on BAR’s Web site. Because the FPR reflects station and inspector performance on vehicles they previously certified, stations and inspectors do not have to be currently performing inspections to generate an FPR score. In addition, vehicles previously certified by a station or inspector do not have to be re-inspected by the same station and inspector for the car to be evaluated under the FPR. So, an inspector who takes a leave of absence for some time could still have an FPR score, and that score could change based on the results in the current inspection cycle of vehicles the inspector previously certified. If, however, the inspector is on leave for years, there will eventually be a point at which there are no longer any vehicles certified by the inspector to generate an FPR score. At that point, the inspector will cease to have an FPR score under the STAR Program. However, an inspector without an FPR score can still perform Smog Check inspections at a STAR station, provided that station has an FPR score of 0.4 or higher or does not have an FPR score because it is either a new station or, similar to the inspector in this example, has a deficient inspection volume. FPR scores are updated every six months, in January and July.

4.13 How can a station with a high FPR score have two inspectors with entirely different FPR scores?

First, it is essential to remember that FPR scores are affected by the quality of inspections performed and inspection volume for vehicles previously certified by both stations and inspectors. For example, let’s assume that two inspectors have been entered into the same station’s analyzer(s) for years and have not been entered into any other station's analyzer(s). Let’s also assume that the two inspectors previously certified the same number of vehicles that are now being inspected in the current inspection cycle. Still, one of the inspectors performed higher quality inspections than the other. In this case, it is pretty simple to understand that the higher-performing inspector will have a better FPR score. Now, let’s consider another scenario for two inspectors who entered into the same station’s analyzer(s) for years at the same station. Let’s also assume that both inspectors perform the same quality of work but with one of the inspectors performing twice as many inspections as the other. Which inspector will have a higher FPR score? The answer depends upon the quality of their identical performance. If their performance is above average, the inspector with the higher inspection volume will have a higher FPR score because the statistical confidence of their

higher performance will be greater with the larger sample size. Similarly, if their performance is below average, the higher volume inspector will have a lower score because, again, the statistical confidence of their higher performance will be greater with the larger sample size. For these reasons, one can’t automatically assume that an inspector with a score of 0.9 performs higher quality inspections than an inspector with a score of 0.75. Instead, scores from July 2013, Page 17, should be evaluated by whether or not they are above 0.5. Scores above 0.5 are trending better than average. Above-average performance should be the goal for stations that want to participate in the STAR Program. Note that the FPR performance standard for inspectors entering a STAR station is 0.4, below the 0.5 level mentioned above. This lower limit was selected to allow inspectors near the standard the benefit of the doubt.

4.14 Why is my FPR so low, even though my results for the STAR short-term measures look good?

The first reason short-term results can differ from the FPR results is the time frame over which the inspection results generated by the station or inspector are being evaluated. The short-term performance measures evaluate inspection performance based on the most recent calendar quarter of data. The FPR, however, evaluates the inspection performance for each station or inspector in the previous inspection cycle. As a result, the short-term performance measures assess performance over a different time than the FPR. Consequently, differences between short-term results and FPR scores could result from station personnel or policy changes. Other reasons why the short-term results can differ from the FPR scores are based on the nature of the measures themselves, as shown below. The short-term performance measures are designed to provide a simple litmus test of recent performance to evaluate stations (and the work done by their inspectors). It can be a great resource in helping a station identify problem areas and improve its overall performance in the Smog Check Program. For instance, if a station fails to perform the fuel evaporative test on vehicles that should be tested, a short-term measure can help a station identify that as an area needing improvement. The short-term measures are not, however, comprehensive. For example, a station’s inspectors can indicate in the analyzer that the ignition timing is adjustable for all vehicles tested at the station and give that station a passing result on this performance measure. However, that does not mean that the station’s inspectors performed the timing test or that the timing test was performed accurately. Similarly, a station may have a low ASM restart rate, indicating that its inspectors aren’t trying to find ways to get vehicles that should otherwise fail to pass the test instead. At the same time, however, that station’s inspectors may

routinely over-condition vehicles before starting the inspection. Neither the improper timing inspections nor the habitual over-conditioning of cars, as well as other more severe

violations, such as clean-piping, would be identified by the short-term measures. For this reason, BAR felt it necessary to develop a more robust, long-term measure of station and inspector performance in the Smog Check Program. The result is the Follow-up Pass Rate (FPR), a performance measure that evaluates both station and inspector behavior from the inspection cycle to the inspection cycle. Anything inspectors do get a vehicle that should fail its Smog Check inspection to pass while still in a failing condition will start to affect their FPR score. Stations that want to score well on both the short-term measures and FPR will always strive to perform accurate Smog Check inspections. July 2013 Page 18

4.15 Should I refuse to inspect older, higher-mileage vehicles to maintain a high FPR score?

Even though Smog Check stations have the right to refuse to inspect vehicles, they are uncomfortable testing. The reason is that all of the performance measures used in the STAR Program, including the FPR, compare the cars inspected by each station and inspector to similar vehicles inspected throughout the state. Therefore, if your station only inspects older, higher mileage vehicles, the results for your station will only be compared to the statewide results for similar older, higher mileage vehicles. Because of this critical factor, there is no more reason to be concerned about certifying an older vehicle with a carburetor than certifying a newer vehicle with fuel injection. What matters is that inspectors perform accurate inspections and properly fail cars

that should fail, regardless of the vehicle's age or mileage.

4.16 Why do my FPR scores jump around?

Each time FPR scores are updated, some stations and inspectors may find that their FPR scores change. This will be more evident for stations and inspectors whose Smog Check inspection performance is closer to average. Others, whose behavior diverges more from average, will find their scores more stable, either at the high or low end of the performance scale. If a station owner or inspector wants consistently high FPR scores, performing consistently high-quality inspections is critical. But, it is essential to note that the sample size can affect STAR scores. The more vehicles previously certified by a station or inspector that are inspected in the current cycle, the easier it is to determine whether or not that station or inspector’s performance is above or below average. This means that scores can change due to the number of vehicles inspected in the current cycle. So, if two inspectors perform similarly and are above average, the inspector with the higher inspection volume will have a higher score. On the other hand, if two inspectors perform similarly but below average, the inspector with the higher inspection volume will have a lower score. This feature can also affect individual inspectors. For example, if an inspector maintains a consistent level of above-average performance with an FPR score of 0.6, that inspector’s FPR score would move closer to 1.0 with an increase in the inspector's inspections. It is also important to remember that inspector performance changes over time, affecting both a station and inspector’s FPR score. Station owners and inspectors need to reflect on what happened two to three years ago to understand how these changes may be driving today’s FPR scores. Were station owners or managers pushing high throughput at the expense of inspection quality? Were inspectors over-conditioning vehicles or moving them in the incorrect gear? Were inspectors taking the time to visually inspect and functionally test all of the emission-related components thoroughly as required by the Smog Check inspection procedures? When trying to understand FPR scores today, look back to see what was driving scores today. Station FPR scores can also change based on which inspectors were operating at the station when the vehicles were last certified and who was managing the station. Even though a station may take steps to address a problem where an inspector was performing improper inspections on July 2013, Page 19, improper certifications issued by that inspector can affect that station’s FPR score for some time. It’s also important to realize that accurate Smog Check inspections may take longer. As a rule of thumb, a comprehensive inspection, including accurate determination of proper inspection procedures and thorough performance of the visual inspection and all applicable functional tests, will often take 20 or more minutes. These times may be reduced somewhat if the inspector is experienced and familiar with the vehicle. Still, as evidenced by results on the STAR short-term performance measures, many inspectors are making more mistakes than they probably realize. When in doubt, slow down and perform the inspection correctly..

5.3 Can I transfer my station’s STAR certification to a prospective buyer of the station?

No. A station’s STAR certification is not transferable to a prospective buyer of that same station. As in the case of a business structure change, the new owner(s) will be issued a new license for the station. This will require the newly licensed station to meet the STAR performance measures to qualify for STAR certification. The evaluations are done at the end of each calendar quarter (i.e., March, June, September, and December). July 2013 Page 20

5.4 Could my station’s STAR certification be affected if I change the station’s business address?

No. Changing a business address is not considered a change in business structure and will not affect a station’s STAR certification.

5.5 Could my station’s STAR certification be affected by failing to renew the station’s licenses on time?

Yes. Failure to renew your station licenses, including your Automotive Repair Dealer registration and Smog Check station license, before the expiration date will cause the station to be delinquent in maintaining a valid license. This will, in turn, lock the station analyzer out from performing smog inspections on “directed vehicles” until the permit (s) is/are current and could jeopardize the station’s STAR certification.