Loading...

Use of Swap Sets to Measure Impact of Model Changes

Published: January 7, 2018 by Reuth Kienow

Swap Set

You just finished redeveloping an existing scorecard, and now it’s time to replace the old with the new. If not properly planned, switching from one scorecard to another within a decisioning or scoring system can be disruptive. Once a scorecard has been redeveloped, it’s important to measure the impact of changes within the strategy as a result of replacing the old model with the new one. Evaluating such changes and modifying the strategy where needed will not only optimize strategy performance, but also maximize the full value of the newly redeveloped model. Such an impact assessment can be completed with a swap set analysis.

The phrase swap set refers to “swapping out” a set of customer accounts — generally bad accounts — and replacing them with, or “swapping in,” a set of good customer accounts. Swap-ins are the customer population segment you didn’t previously approve under the old model but would approve with the new model. Swap-outs are the customer population segment you previously approved with the old model but wouldn’t approve with the new model. A worthy objective is to replace bad accounts with good accounts, thereby reducing the overall bad rate. However, different approaches can be used when evaluating swap sets to optimize your strategy and keep:

  • The same overall bad rate while increasing the approval rate.
  • The same approval rate while lowering the bad rate.
  • The same approval and bad rate but increase the customer activation or customer response rates.

It’s also important to assess the population that doesn’t change — the population that would be approved or declined using either the old or new model. The following chart highlights the three customer segments within a swap set analysis.

With the incumbent model, the bad rate is 8.3%. With the new model, however, the bad rate is 4.9%. This is a reduction in the bad rate of 3.4 percentage points or a 41% improvement in the bad rate.

This type of planning also is beneficial when replacing a generic model with another or a custom-developed model.

Click here to learn more about how the Experian Decision Analytics team can help you manage the impacts of migrating from a legacy model to a newly developed model.

Related Posts

Here are the four steps fintechs should take to reenter the lending market intelligently, while mitigating as much risk as possible.

Published: January 28, 2021 by Jesse Hoggard

Financial institutions preparing for the launch of the Financial Accounting Standard Board’s (FASB) new current expected credit loss model, or CECL, may have concerns when it comes to preparedness, implications and overall impact. Gavin Harding, Experian’s Senior Business Consultant and Jose Tagunicar, Director of Product Management, tackled some of the tough questions posed by the new accounting standard. Check out what they had to say: Q: How can financial institutions begin the CECL transition process? JT: To prepare for the CECL transition process, companies should conduct an operational readiness review, which includes: Analyzing your data for existing gaps. Determining important milestones and preparing for implementation with a detailed roadmap. Running different loss methods to compare results. Once losses are calculated, you’ll want to select the best methodology based on your portfolio. Q: What is required to comply with CECL? GH: Complying with CECL may require financial institutions to gather, store and calculate more data than before. To satisfy CECL requirements, financial institutions will need to focus on end-to-end management, determine estimation approaches that will produce reasonable and supportable forecasts and automate their technology and platforms. Additionally, well-documented CECL estimations will require integrated workflows and incremental governance. Q: What should organizations look for in a partner that assists in measuring expected credit losses under CECL? GH: It’s expected that many financial institutions will use third-party vendors to help them implement CECL. Third-party solutions can help institutions prepare for the organization and operation implications by developing an effective data strategy plan and quantifying the impact of various forecasted conditions. The right third-party partner will deliver an integrated framework that empowers clients to optimize their data, enhance their modeling expertise and ensure policies and procedures supporting model governance are regulatory compliant. Q: What is CECL’s impact on financial institutions? How does the impact for credit unions/smaller lenders differ (if at all)? GH: CECL will have a significant effect on financial institutions’ accounting, modeling and forecasting. It also heavily impacts their allowance for credit losses and financial statements. Financial institutions must educate their investors and shareholders about how CECL-driven disclosure and reporting changes could potentially alter their bottom line. CECL’s requirements entail data that most credit unions and smaller lenders haven’t been actively storing and saving, leaving them with historical data that may not have been recorded or will be inaccessible when it’s needed for a CECL calculation. Q: How can Experian help with CECL compliance? JT: At Experian, we have one simple goal in mind when it comes to CECL compliance: how can we make it easier for our clients? Our Ascend CECL ForecasterTM, in partnership with Oliver Wyman, allows our clients to create CECL forecasts in a fraction of the time it normally takes, using a simple, configurable application that accurately predicts expected losses. The Ascend CECL Forecaster enables you to: Fulfill data requirements: We don’t ask you to gather, prepare or submit any data. The application is comprised of Experian’s extensive historical data, delivered via the Ascend Technology PlatformTM, economic data from Oxford Economics, as well as the auto and home valuation data needed to generate CECL forecasts for each unsecured and secured lending product in your portfolio. Leverage innovative technology: The application uses advanced machine learning models built on 15 years of industry-leading credit data using high-quality Oliver Wyman loan level models. Simplify processes: One of the biggest challenges our clients face is the amount of time and analytical effort it takes to create one CECL forecast, much less several that can be compared for optimal results. With the Ascend CECL Forecaster, creating a forecast is a simple process that can be delivered quickly and accurately. Q: What are immediate next steps? JT: As mentioned, complying with CECL may require you to gather, store and calculate more data than before. Therefore, it’s important that companies act now to better prepare. Immediate next steps include: Establishing your loss forecast methodology: CECL will require a new methodology, making it essential to take advantage of advanced statistical techniques and third-party solutions. Making additional reserves available: It’s imperative to understand how CECL impacts both revenue and profit. According to some estimates, banks will need to increase their reserves by up to 50% to comply with CECL requirements. Preparing your board and investors: Make sure key stakeholders are aware of the potential costs and profit impacts that these changes will have on your bottom line. Speak with an expert

Published: June 12, 2019 by Laura Burrows

Machine learning's ability to consume vast amounts of data to uncover patterns and deliver results makes it well suited for the credit risk industry

Published: September 12, 2018 by Alan Ikemura

Subscription title for insights blog

Description for the insights blog here

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Categories title

Lorem Ipsum is simply dummy text of the printing and typesetting industry. Lorem Ipsum has been the industry's standard dummy text ever since the 1500s, when an unknown printer took a galley of type and scrambled it to make a type specimen book.

Subscription title 2

Description here
Subscribe Now

Text legacy

Contrary to popular belief, Lorem Ipsum is not simply random text. It has roots in a piece of classical Latin literature from 45 BC, making it over 2000 years old. Richard McClintock, a Latin professor at Hampden-Sydney College in Virginia, looked up one of the more obscure Latin words, consectetur, from a Lorem Ipsum passage, and going through the cites of the word in classical literature, discovered the undoubtable source.

recent post

Learn More Image

Follow Us!