Republican presidential candidate Mitt Romney promised during a private fundraiser in Florida on Sunday to try to do away with or consolidate several federal cabinet agencies, including the education and housing departments.

“I’m going to take a lot of departments in Washington, and agencies, and combine them,” Romney said, according to NBC News. “Some eliminate, but I’m probably not going to lay out just exactly which ones are going to go.”

The former Massachusetts governor specifically said the Department of Housing and Urban Development “might not be around later.”