Abhi well it depends what is the machine supposed to do. I had a server that was basically just serving files, no high CPU work only loads of hard disks, and just leave it in a room with the AC on was fine. Usually when you buy a computer that is made to be a server they are equipped with good cooling, oftentimes very noisy fans included =D
If you like the idea just get yourself a raspberry pi or something, for like 30-40 bucks you can have your own server at home! I have 2 I use as personal cloud, syncing files and torrent seeders