An off-duty police officer noticed Russell Lawrence Ziemba, 49, acting erratically and belligerent at the hotel, reported ABC News.
It comes as cities across the U.S. and around the world step up security for New Year's Eve celebrations.
Police said hotel security officers confronted the unruly man early Sunday at the bar at Houston's Hyatt Regency Hotel and called for assistance when he refused to be subdued. Officers arrived on the scene and shortly after found several weapons and ammunition in his hotel room. Police said responding officers found a rifle, a shotgun and a handgun in his room, plus ammunition. The hotel is planning a big bash for New Year's Eve, one that includes the dropping of 50,000 balloons at midnight.
Houston Police Chief Art Acevedo confirmed via Twitter on December 31 that the situation is contained and that there are "no specific threats" to Houston.
NBC reporter Jacob Rascon said on Twitter that the Hyatt Hotel had planned celebrations for Sunday night in honor of the 40th anniversary of Houston's New Year's Eve party and expected hundreds of guests to join.
Police are still investigating the incident and will release more information about the suspect in due course.
Tom Netting, managing director of Hyatt Regency Houston, said in a statement that they were fully cooperating with authorities on the investigation.