The Quick Read: Sometimes, but only in one direction and only inside limits. A lender can be stricter than the agency rules, and it can weigh your whole file, but it cannot waive the investor’s loan-to-value cap, seasoning, or ownership tests on a loan it plans to sell. Where the score floor comes from the lender’s own policy, that is the part that varies from one lender to the next.
Who Actually Sets the Score Floor?
Three layers set it, and only two of them have any give. The agency or investor sets the base rules. The lender adds its own policy on top. The underwriter then judges the full file within both.
Here is how the layers work for a conventional loan:
| Layer | Who controls it | Can it flex? |
|---|---|---|
| Agency / investor rules | Fannie Mae, Freddie Mac, FHA, VA | Not for the lender on a loan it sells |
| Lender overlay | The lender | Yes, but only stricter |
| File judgment | The underwriter | Within the first two layers |
An overlay is a lender’s own rule that sits on top of the agency minimum. It can only make the standard tighter. That is why one lender says no and another says yes to the same borrower at the same score. Both are following the same agency rules. They just have different overlays.
Across the wholesale programs Lendmire arranges, the conventional lanes start at a 620 decision score, subject to lender guidelines and full file review. A wholesale lane that reaches 89.99% LTV with no mortgage insurance asks for a 680 score and a 50% ratio on a thirty-year fixed primary residence at a conforming balance. Those are program figures. Another lender may set a different floor, and many do.
Has the Agency Score Minimum Changed?
Yes, for automated files. Fannie Mae announced that minimum credit score requirements no longer apply to loans run through its Desktop Underwriter system. The system now weighs risk factors together instead of cutting off at one number.
That does not mean a score doesn’t matter. A lender’s own policy can still require one. Manually underwritten loans still carry a floor under the Eligibility Matrix. So even where no hard floor applies, a lower score can change what the loan costs.
What Can Bend (and What Can’t)?
What bends is the weight your file gives each factor. What doesn’t bend is the structure of the loan.
What can flex:
- Compensating factors. These are strengths that offset a weaker area, such as low debt, solid reserves or stable income.
- Automated versus manual review. The automated finding governs most files. A manual review follows the Eligibility Matrix with its own score and reserve factors.
- Which lender you use. Overlays differ, so a decline at one lender may not be a decline everywhere.
What can’t flex on a loan the lender plans to sell:
- The maximum LTV for the occupancy and unit count.
- The seasoning tests.
- The ownership tests.
The Fannie Mae Selling Guide requires the first mortgage being paid off to be at least 12 months old. A lender can’t wave that away for a good customer. A strong score does not buy extra leverage either.
How Much Can You Borrow at Any Score?
The cap depends on the home, not on how well you score. For a conventional cash-out refinance, the maximum is 80% LTV on a one-unit principal residence. It is 75% on two- to four-unit principal residences, second homes and investment property, per the Fannie Mae Eligibility Matrix. LTV, or loan-to-value, is the loan balance divided by the home’s appraised value. Final terms depend on lender guidelines, property type, leverage, and the borrower’s complete credit picture.
The new loan must also cover closing costs and any financed amounts inside that cap. So a lower score mostly changes your price and the lender’s willingness. It does not change the ceiling. The matrix also requires minimum reserves on some automated cash-out files when the debt-to-income ratio is above 45%. Reserves are the months of payments you keep in savings after closing.
Does the Loan Type Change the Flexibility?
Yes. Each program puts the rule in a different place.
| Program | Where the score rule lives | Lender discretion |
|---|---|---|
| Conventional | Investor guideline plus lender policy | Moderate |
| FHA | HUD handbook plus lender overlays | Overlays allowed |
| VA | Program has no set minimum | Lender overlays decide |
VA is the clearest example. A VA lender conference presentation lists no minimum credit score and says a lack of credit is not viewed as a negative. So any floor a VA borrower meets is typically a lender overlay, and those vary.
For FHA, HUD’s handbook is the authority on cash-out rules. Lenders may add overlays there too. Check the handbook or ask the lender in writing rather than trusting a number you read online.
Streamlines are a different product. FHA Streamline and VA IRRRL are for existing FHA and VA loans, and they do not deliver cash to you. HUD describes the FHA Streamline as a refinance of a current FHA-insured loan with a net tangible benefit. If you want cash out, a streamline is not the tool.
Which Credit Score Does the Lender Use?
The lender uses a mortgage score, not the free score on your banking app. The Fannie Mae Selling Guide lists the approved models as classic FICO, VantageScore 4.0 and FICO 10T. Lenders pull scores from the credit bureaus, and with more than one borrower the lower representative score typically applies.
That is why your consumer app can show a number higher than the one the lender quotes. Ask which score and which model they are using before you compare offers.
Three Scenarios
Same score, two lenders. Two homeowners have identical files at the same score, equity and ratios. Lender A has no overlay and approves. Lender B has a higher internal floor and declines. The agency rule never changed. Only the overlay did.
Lower score, strong file. A borrower sits at a modest score but has low debt, steady income and solid reserves. The automated system weighs the whole file, and the result can come back approvable. The tradeoff is usually in pricing, not in a bigger loan.
Borderline score, high ratios. A borrower has an acceptable score but a heavy debt load. Here the ratio is the problem, not the score. Paying down balances or lowering the loan size may help more than raising the score by a few points.
What Does Flexibility Cost?
It usually costs you somewhere else. The score changes pricing, because credit fees tie to score and LTV. Above 80% LTV, conventional loans carry mortgage insurance. It is required above 80%, you can request cancellation at 80% of the original value with good payment history, and the servicer must end it at 78%. That rule comes from the Homeowners Protection Act.
Cash-out also raises the balance. The CFPB’s guide on using home equity notes that a cash-out refinance can extend your payoff time and raise the monthly payment, since the loan is larger. It also says lenders typically want you to keep 10% to 20% of your home’s value as equity.
CFPB research adds that turning other debt into mortgage debt puts your home at risk if payments become unsustainable. Weigh that before you roll in credit card balances.
Red Flags: When “Flexibility” Is a Warning Sign
Real flexibility is a lender weighing your file. These are not:
- A promise of approval before the lender has reviewed your file.
- Pressure to leave something off the application or adjust a number.
- A “no-cost” pitch that doesn’t explain where the costs went. The costs are built into the rate or the balance.
- A quote that changes the loan type without telling you why.
An honest lender explains which rule is blocking you. If it can’t, ask for the guideline in writing.
If You’re Told No
Find out whether it’s an overlay or an agency rule. Ask the lender directly which one it is.
- Overlay: Shop another lender. A broker can compare programs across several wholesale lenders.
- Agency rule: Change the loan type, the loan size or the profile. For example, drop to a lower LTV or wait out a seasoning period.
- Credit event: Waiting periods are agency rules. After a chapter 7 discharge it is four years. After a foreclosure it is seven. After a short sale or deed-in-lieu it is four. Documented extenuating circumstances can shorten them.
- No credit score at all: Fannie Mae routes these files to a nontraditional credit section, and VA allows non-traditional tradelines.
Texas is a special case. A cash-out on a homestead there is capped by the state constitution at the agency figure, and the wholesale 89.99% lane is not written there.
Pre-Application Checklist
- You know your occupancy: primary, second home or investment. Occupancy sets the LTV cap.
- The loan you’re paying off is at least 12 months old, note date to note date.
- At least one borrower has been on title for six months, unless an exception such as inheritance or a legal award applies. Cash buyers can sometimes use delayed financing within six months of purchase.
- You’ve asked which score model the lender uses.
- Your debt-to-income ratio fits the program’s ceiling. The automated programs allow up to 50%.
- You’ve asked whether the floor is an agency rule or an overlay.
Tax treatment can depend on your situation; borrowers should speak with a qualified tax professional before relying on any deduction or credit.
Key Terms Defined
Overlay: A lender’s own rule that sits on top of the agency minimum and can only make it stricter.
Compensating factor: A strength in your file, such as low debt or strong reserves, that offsets a weaker area.
Seasoning: The required waiting period, such as how long you have held the loan or title before refinancing.
Manual underwriting: A human review of your file against the Eligibility Matrix instead of an automated finding.
LTV: Loan-to-value, the loan balance divided by the home’s appraised value.
Frequently Asked Questions
Can a lender make an exception to the credit score rules?
Only within its own policy. A lender can relax its own overlay, but it cannot waive the investor’s LTV cap, seasoning or ownership tests on a loan it plans to sell. Exceptions that exist, such as inheritance for ownership timing, are written into the agency rules themselves.
Why did one lender say no and another say yes?
Usually an overlay. Both lenders follow the same agency rules, but each can add its own stricter floor. Ask the lender whether the denial reason is an agency rule or its own policy, then compare programs.
Does a cash-out refinance need a higher score than a regular refinance?
Often, yes, because cash-out carries more risk and lower maximum leverage. A rate-and-term refinance on a primary residence can reach 95% LTV, while a conventional cash-out tops out at 80% on one unit. All of it is subject to lender guidelines and full file review.
Which credit score do lenders use?
A mortgage score from an approved model, pulled from the credit bureaus. With more than one borrower, the lower representative score typically applies. It may differ from the score on your banking app.
Can I qualify with a lower score?
Possibly. Automated underwriting weighs the whole file, and VA sets no program minimum. Expect the tradeoff to show up in pricing or mortgage insurance, and expect lender overlays to vary. Nothing here is a commitment to lend.
If you are weighing a cash-out refinance against keeping the loan you have, Lendmire can help you compare the programs and the equity each one reaches. Start with Lendmire’s cash-out refinance programs, or read Lendmire’s piece on the minimum credit score for a cash-out refinance.
For your own numbers, request a scenario review with Lendmire.
For current guidelines and terms, see Lendmire’s refinance programs page.
About Lendmire
Lendmire (NMLS# 2371349) is a mortgage brokerage serving homeowners and home buyers in 16 states. FHA, VA, conventional and jumbo purchase and refinance loans are arranged through wholesale lending channels; Lendmire brokers the financing and the lender underwrites each application. Scotsman Guide named Lendmire a Top Mortgage Workplace in both 2025 and 2026.
Get Started
Ready to find the right loan for you?
In about 30 seconds you can review financing options available for your home or investment property. No commitment required.
Informational only. Not a Loan Estimate, approval, or commitment to lend. Program availability and eligibility are subject to lender guidelines, credit approval, property review, and underwriting.
References
2. Fannie Mae Selling Guide B2-1.3-03, Cash-Out Refinance Transactions
3. Fannie Mae Eligibility Matrix
4. VA Loan Guaranty Conference, Credit Underwriting
5. HUD Single Family Streamline Refinance
6. Fannie Mae Selling Guide B3-5.1-01, General Requirements for Credit Scores
7. CFPB, Using Your Home Equity guide
This article is part of Lendmire’s cash-out refinance program — full qualification details, guidelines, and scenarios live on the program page.
Related reading: Cash-Out Refinance for Homeowners Who Cashed Out Before · How a Lender Processes a Cash-Out Refinance Application · How to Get the Most From a Cash-Out Refinance on Your Home
Brandon Miller
Founder & CEO, Mortgage Loan Originator, Lendmire LLC
- Mortgage Loan Originator · NMLS# 1129696 · Verify on NMLS Consumer Access
- North Carolina Real Estate Broker · License# 343312 · Verify on NCREC
- North Carolina Insurance Producer · License# 19053198 · Property, Casualty, Life, Health · Verify on NAIC SBS
- Lendmire LLC · Firm NMLS# 2371349 · Verify firm licensure
Compliance and disclosures. Lendmire (NMLS# 2371349) is a licensed mortgage broker and is not a direct lender, depository institution, financial advisor, or tax professional. Content in this article is general market analysis and educational information — not financial, legal, or tax advice for any specific situation. Lendmire does not guarantee loan approval; every transaction is subject to underwriting by the funding lender. Mortgage pricing and loan program guidelines are subject to change at any time without notice and vary by borrower characteristics, property type, and state regulations. Lendmire complies with Equal Housing Opportunity. Licensure verification: NMLS Consumer Access.