The Quick Read: Usually yes, but the loan is classed as a cash-out refinance, not a rate-and-term refinance or a streamline. A family loan is normally an unsecured note, not a lien on the home, so it falls outside the limited cash-out payoff rules. The new mortgage replaces your current one, the family note is paid at closing, and the leverage, seasoning and pricing rules for cash-out apply.
Why Is Repaying Family Money a Cash-Out Refinance?
The classification follows the debt, not your intent. Freddie Mac’s Guide section 4301.5 defines a cash-out refinance as one with no restrictions on how the proceeds are used, and that includes paying off money borrowed to buy the home. When funds were borrowed for the purchase, the cash-out proceeds must pay off or pay down those funds, and the settlement statement must show it.
The limited cash-out (rate-and-term) lane is narrower. Fannie Mae’s limited cash-out rules allow a subordinate lien to be paid off only when the entire amount was used to buy the home. Freddie Mac’s no cash-out refinance page says the same about junior liens secured by the property. Both agencies write that lane around liens on the home.
A family loan is typically an unsecured promissory note. No agency text addresses unsecured family notes by name, so treat this as an inference from the lien-based wording, not a quoted rule. Because the note is not a lien on the home, it generally lands in the cash-out lane. If your relative recorded a lien and the entire amount went into the purchase, the limited route may be open. That is an edge case for underwriting to confirm.
A rental or second home changes the leverage, but not the answer. Occupancy decides how much equity the lender requires, and this article is about the home you live in.
How Does the Process Work Step by Step?
Here is the usual path, from first look to closing.
1. Confirm it was a loan, not a gift. A gift is not repaid, and the gift letter states that no repayment is expected. If your purchase file called the money a gift, ask the loan officer how a later “repayment” would be handled before you do anything.
2. Check seasoning. Conventional cash-out needs the first mortgage being paid off to be at least 12 months old, measured note date to note date, and a borrower on title for six months.
3. Underwrite the new loan. The new payment replaces the old one, and the family note is eliminated at closing. Any part of the family loan left unpaid still counts in your debt-to-income ratio.
4. Appraise. A cash-out refinance relies on an appraised value and a loan-to-value test.
5. Close with the payoff on paper. The payoff should appear as a line item on the Closing Disclosure. A signed payoff letter or the original note from your relative is the obvious support. No agency source names the exact document, so the lender’s checklist governs.
The Fannie Mae Selling Guide on cash-out refinances lists the same seasoning tests and adds six months of reserves when DTI exceeds 45% on a DU casefile. Lendmire’s cash-out refinance programs follow the same seasoning logic across the wholesale lenders it works with.
What Equity Do You Need?
Leverage is the number that decides most files. On conventional loans, the cash-out limit is 80% loan-to-value on a one-unit principal residence and 75% on two- to four-unit principal residences. Subject to lender guidelines, that means you need meaningful equity left over after the payoff, not just enough to cover the family note.
Picture a buyer who put 5% down using family money and has held the home for about a year and a half. Even with some appreciation and a bit of principal paid down, the balance may still sit above what an 80% cash-out cap allows. In that case the refinance can’t reach the family payoff, and waiting for equity to build, or paying the family back in installments, may be the better path.
A wholesale lane reaches 89.99% LTV with no mortgage insurance on a primary residence. It requires a 680 score, a 50% ratio, a thirty-year fixed on a conforming balance, and its own six months of seasoning. Not every file fits, and in Texas the wholesale lane isn’t written on homestead cash-out, because the state constitution caps it at the agency figure. Exact terms depend on the lender’s guidelines, property type, leverage, and a full review of the borrower’s file.
Credit matters too. Wholesale conventional programs start at a 620 decision score, and the automated finding governs most files, with a total ratio ceiling of 50%.
Can You Do It Soon After Buying?
Not always. Fannie Mae’s delayed financing exception waives the six-month wait for cash purchases. For a loan borrowed from an unsecured source, the refinance settlement statement must show all cash-out proceeds paying off or paying down that loan.
The catch: delayed financing depends on the original purchase having no mortgage financing. If you bought with a mortgage and a family down payment, you likely don’t fit it. Confirm with underwriting before building a plan around it.
One more timing trap. A limited cash-out is ineligible if you completed a cash-out refinance with a note date 30 days or less before the new application, per Fannie Mae’s prohibited refinancing practices.
What About FHA and VA Loans?
Neither streamline is built for this.
| Program | Fits a family payoff? | Why |
|---|---|---|
| Conventional cash-out | Yes | Proceeds can retire borrowed purchase funds |
| FHA Streamline | No | Existing FHA loans only, minimal cash back |
| FHA cash-out | Possibly | Proceeds not limited to specific purposes |
| VA IRRRL | No | Refinances a VA loan at a lower rate |
| VA cash-out | Possibly | Loan amount exceeds the payoff of the old loan |
HUD’s handbook describes streamline refinances as lowering the payment on an FHA-insured mortgage with no cash back beyond minor adjustments, per HUD Handbook 4155.1. That handbook is older, so confirm current rules. The VA’s circular on refinance types separates the IRRRL from Type I and Type II cash-out loans, and a Type II loan amount exceeds the payoff of the loan being refinanced. Seasoning for a VA-to-VA IRRRL is the later of 210 days and six payments, and the IRRRL carries a 0.5% funding fee unless exempt.
FHA cash-out may carry its own occupancy requirement. Verify it with the lender before counting on it.
Is It Worth It? The Tradeoff
It depends on the size of the family loan against the size of your whole mortgage.
A cash-out refinance replaces the whole loan, not just the family portion. Your rate, term and costs reset.
The refinance probably makes sense when:
- Your existing mortgage terms are no better than what a new loan would offer.
- The family note carries a cost or a deadline that is worse than the refinance.
- You have comfortable equity after the payoff and the DTI works.
It probably doesn’t when:
- Your current first mortgage is one you’d be happy to keep.
- The family loan is small enough to pay down from savings.
- You’d be left thin on equity.
A family note is informal. A mortgage is not. Converting one to the other raises the stakes, even if your relative would never foreclose on you.
How Does It Compare With the Alternatives?
| Option | First mortgage | Best when |
|---|---|---|
| Cash-out refinance | Replaced | Current terms are no better than new ones |
| HELOC or home equity loan | Left in place | You like your current mortgage |
| Pay from savings | Left in place | The note is small relative to your cash |
| Installment repayment | Left in place | You need time to build equity |
If the first mortgage is one you want to keep, that structure deserves a look. Lendmire’s piece Smaller HELOC vs Larger Cash-Out Refinance for a Rental Down Payment walks through that tradeoff, and the same reasoning applies here.
Cash-out pricing generally costs more than rate-and-term pricing, and closing costs can often be financed, subject to program rules. A refinance that costs more than the family loan is worth is a poor trade.
What Mistakes Should You Avoid?
Hiding or relabeling the family money. Fannie Mae’s rule on personal unsecured loans says they are not acceptable sources for a down payment, closing costs or reserves. A gift is acceptable on a principal residence. If the family money was an undisclosed loan at purchase, that is an eligibility issue for the original file. Don’t paper over it now. Tell the loan officer the facts and let them advise.
Converting a gift into a loan after the fact. If the file said gift, the repayment question gets harder. Ask first.
Skipping the paperwork. Keep the original note, proof of the transfer and a payoff letter. Your relative should also expect to receive the money in a way that matches the paper trail.
Assuming the refinance is automatic. Seasoning, equity, DTI and reserves all have to line up. Lender guidelines and full file review decide the outcome, and nothing here is a commitment to lend.
Tax treatment can depend on your situation; borrowers should speak with a qualified tax professional before relying on any deduction or credit.
How Do You Talk to Your Family About Payoff?
Keep it practical. Tell your relative you are exploring a refinance and that the timing depends on seasoning and appraisal, not just on your intent. Ask for the original note and a written payoff statement early. If they need the money by a certain date, say so plainly and compare it to your seasoning calendar before you promise anything. If the dates don’t match, an installment plan or a smaller equity product may bridge the gap.
Key Terms Defined
Cash-out refinance: A new mortgage larger than your current balance, or one whose proceeds go to uses beyond the old loan, such as retiring other debt.
Limited cash-out (rate-and-term) refinance: A refinance that pays off the existing first mortgage, closing costs and certain purchase-money liens, with only incidental cash back.
Seasoning: The minimum time a loan or ownership must exist before a refinance is allowed.
Purchase-money lien: A recorded claim on the home, created at purchase, that secures money used to buy it.
Unsecured note: A written promise to repay that is not backed by a lien on the property.
Debt-to-income ratio (DTI): Your monthly debt payments divided by your monthly gross income.
Frequently Asked Questions
Can I use a rate-and-term refinance to repay my parents?
Usually not. The limited cash-out lane only pays off a lien that was used entirely to buy the home. An unsecured family note generally isn’t one, so lenders treat the payoff as cash-out. If the note was recorded as a lien and funded the whole purchase, ask underwriting whether the limited route applies.
How long do I have to wait after buying?
For conventional cash-out, a borrower must be on title for six months, and any first mortgage being paid off must be at least 12 months old. Delayed financing can waive the six-month wait only for cash purchases. If you used a mortgage to buy, plan around the standard waits.
Can I get cash back on top of the payoff?
Yes, in many cases. Whatever you take must still fit within the leverage limit, which is 80% on a one-unit principal residence for conventional cash-out.
What if my family loan was listed as a gift?
Ask the loan officer before you proceed. A gift letter says no repayment is expected, so repaying that money later creates a documentation conflict. Be accurate about what happened. Misstating the facts puts both the old file and the new one at risk.
Does the family loan still count against my DTI?
Any balance that remains after closing is counted in your debt-to-income ratio. If the refinance pays it off in full, the family note drops out and the new mortgage payment takes its place. Above a 45% DTI, Fannie Mae requires six months of reserves on DU casefiles.
If you are weighing a cash-out refinance against keeping the loan you have, Lendmire can help you compare the programs and the equity each one reaches. For your own numbers, request a scenario review with Lendmire.
For current guidelines and terms, see Lendmire’s refinance programs page.
About Lendmire
Lendmire, NMLS# 2371349, is a mortgage brokerage with consumer lending licenses in 16 states. FHA, VA, conventional and jumbo purchase and refinance loans are arranged through wholesale lending partners, and each application is reviewed individually by the lender. Scotsman Guide named Lendmire a Top Mortgage Workplace in both 2025 and 2026.
Get Started
Ready to find the right loan for you?
In about 30 seconds you can review financing options available for your home or investment property. No commitment required.
Informational only. Not a Loan Estimate, approval, or commitment to lend. Program availability and eligibility are subject to lender guidelines, credit approval, property review, and underwriting.
References
2. Fannie Mae Selling Guide, B2-1.3-02 Limited Cash-Out Refinance Transactions
3. Freddie Mac no cash-out refinance page
4. Fannie Mae Selling Guide, B2-1.3-03 Cash-Out Refinance Transactions
5. Fannie Mae’s prohibited refinancing practices
8. Fannie Mae Selling Guide, B3-4.3-17 Personal Unsecured Loans
This article is part of Lendmire’s Refinance series — every loan program’s qualification details, guidelines, and scenarios live on the loan options page.
Related reading: How Much Equity a Cash-Out Refi Releases When Scaling to Ten Doors · Sell vs Cash-Out Refi When You Need Equity for the Next Door · Can an S-Corp Owner Cash Out Without Tax Returns?
Brandon Miller
Founder & CEO, Mortgage Loan Originator, Lendmire LLC
- Mortgage Loan Originator · NMLS# 1129696 · Verify on NMLS Consumer Access
- North Carolina Real Estate Broker · License# 343312 · Verify on NCREC
- North Carolina Insurance Producer · License# 19053198 · Property, Casualty, Life, Health · Verify on NAIC SBS
- Lendmire LLC · Firm NMLS# 2371349 · Verify firm licensure
Disclosure information. Lendmire is a state-licensed mortgage brokerage under NMLS# 2371349. Lendmire is not a depository institution, direct lender, or financial advisor — all loans referenced are placed through wholesale lender partners and are subject to each lender's underwriting standards. This article is provided for general informational purposes and is not a commitment to lend, nor does it constitute financial, legal, or tax advice. Loan programs, terms, rates, and qualification standards change without notice and depend on borrower profile, property type, and the state in which the subject property is located. Equal Housing Opportunity provider. NMLS Consumer Access: nmlsconsumeraccess.org.