President Trump's North Carolina rally was panned by two people close to him: his wife, first lady Melania Trump, and his daughter, Ivanka Trump.

Both women, as well as Vice President Mike Pence, told Trump they didn't like how the crowd started chanting "Send her back!" after he attacked Rep. Ilhan Omar (D-Minn.), people with knowledge of the matter told CBS News on Thursday. Omar, a naturalized citizen who was born in Somalia and came to the U.S. as a young refugee, was one of the four Democratic congresswomen of color he tweeted needed to "go back" to their original countries.

Trump didn't try to stop the chanting, which lasted for about 13 seconds, or admonish the crowd. When asked about the incident on Thursday, Trump told reporters he "felt a little bad about it," and insisted he "started speaking very quickly" in order to get the crowd under control.

Earlier in the day, Trump discussed the chant with his inner circle, CBS News reports, and shared his concerns that if he backed down, his supporters would be upset.