Alex Wong/Getty Images

Rep. Steve Scalise (R-La.) on Wednesday said if "something really formal" happens with the Justice Department's investigation of Rep. Matt Gaetz (R-Fla.), Republican leadership will "of course react and take action."

The Justice Department is investigating whether Gaetz, 38, had sex with a 17-year-old girl and paid for her to travel out of state with him, allegations that Gaetz denies. Scalise, the No. 2 House Republican leader, told reporters that he hasn't talked to Gaetz about the investigation, but will likely meet with him later this week.

"It's serious things alleged," Scalise told reporters. "Obviously we want to get the facts." Gaetz is a member of the House Armed Services and Judiciary committees, and Scalise said GOP lawmakers who find themselves facing serious charges are removed from their committees.

Last week, Rep. Adam Kinzinger (R-Ill.) became the first Republican member of Congress to call on Gaetz to resign, and on Sunday, Rep. Liz Cheney (R-Wyo.), the No. 3 House GOP leader, said the allegations against Gaetz are "sickening."