This Is BellGab: > Technology

High Performance Computing

(1/32) > >>

(Sandman) Logan-5:
This thread should be used for all aspects of HPC and Clustering. If you've built your own system and are proud of it, show it off here too - please include the extra goodies, specs, and bench tests if you did them.




The first question you need to ask yourself is: Are the programs you are running compute intensive, or memory / hard-disk intensive ? If you are running highly parallel programs like GIMP, POVRAY(not parallel coded), Scientific Computational Modelling, or numbers crunching programs, keep reading.

Some of the hardware factors that determine a computer's speed of execution are cpu frequency and # of cores, memory speed and rank, interconnect speed between components, disk write (and [not so much] read) speeds, PCI-e bandwidth,  NIC bandwidth and interconnect technology (copper, fiber, infiniband, etc.)

Traditional cluster computers dependended on multiple independant systems connected through an ethernet with switches controlling packet routing. Switches are expensive, contribute to latency, and are a wiring mess. 
What if you could get rid of the interconnect wiring and the switches, juice the ethernet and keep all the boards contained in a single tower with 4 nodes for under $6,000.00 ?

Worth checking out ?

One more thing, when you're not running highly parallel computational tasks, this system also doubles as a workstation. You could build yourself a system like this through lots of research, trial and error, and writing your own code to tie everything together, or you can check out the following links.

http://www.clustermonkey.net/Interconnects/experiments-with-switchless-10gige-the-bonded-loop.html - Lots of good clustering info.
Beowulf info + links - http://fscked.org/writings/clusters/cluster-1.html

-------------------------------------------------   The Limulus Project!    -----------------------------------------------------

http://limulus.basement-supercomputing.com/

Buy one pre-built or get help designing one. 

Limulus Benchmarks

Base Model $5,495.00  here,  + Spec Sheet



-----------------------------------------------   Clustering Books   ---------------------------------------------------------------------------------

http://www.clustermonkey.net/Columns/Cluster-Newbie/


---------------------------------------------------------------------------------------------------------------------------------------------------------

Down & dirty use of old computers - Beowulf.

...And just so everyone that reads this thread has an understanding of how computers work - Don't let the magic smoke escape !

Explanation:

The core of a computer is a small trapped evil spirit (it is no coincidence that UNIX and GNU/Linux processes are called daemons!) This imp is imprisoned in your computer as punishment for something it did in the netherworld. Generally speaking, the more evil the imp is, the faster the computer is. The imps inside 1,000Mhz and slower computers are usually just big fat jerks - a.k.a. Sendas. There are also lesser ghosts and hobgoblins that inhabit the expansion cards and peripherals of your computer. These evil spirits are trapped within the hardware of your computer. Take a screwdriver, open up your computer, and take a look at the circuit boards. They are usually green, and are covered with complex patterns of thin copper lines. These are Circuit Runes, written in arcane and ancient languages that describe the magic spells that bind the imps to the chips. Be very careful with circuits. If you scratch off even the tiniest bit of the runes, the spell will be broken, and the imp will escape in a puff of magic smoke. If you coincidently happen to scratch these runes while the imp is awake and plugged to power, your fingers might burn and you would be thrown back with a shock. Well, that is the evil nature of the imps. The movie series Terminator is about what could happen if the evil of the imps in computers comes to life and take control. Also note the serial and part numbers printed on the boards. These identify exactly what sort of evil spirit it is, in case you ever have to order a replacement from the factory. :o

(Sandman) Logan-5:
Canary; faster than Hadoop.

(Sandman) Logan-5:
Next Generation parallel file-system: OrangeFS

http://www.hpcwire.com/2011/11/18/parallel_file_system_orangefs_starts_to_build_a_following/

(Sandman) Logan-5:
OK everyone. I may have overlooked something here. HPC runs Linux. If you want an M$ system, SQL Server has clustering built in, but you'll need to buy a yearly license. The last instance of M$ I've used was SQL_Server_2008_R2. HPC is mainly a Linux thing.

albrecht:

--- Quote from: (Sandman) Logan-5 on March 20, 2016, 09:21:52 PM ---OK everyone. I may have overlooked something here. HPC runs Linux. If you want an M$ system, SQL Server has clustering built in, but you'll need to buy a yearly license. The last instance of M$ I've used was SQL_Server_2008_R2. HPC is mainly a Linux thing.

--- End quote ---
I only downloaded your last post because I don't understand this stuff and, figured, a pdf would infect my XP computer.  ;) But seriously, being a person not about computers since BASIC and dBASE, I cleaned on old laptop and put on MINT (Linux, I guess based) for random, non-secure use (watch a movie etc and more of an experiment.) And old laptap Dell works very fast and can watch movies out on the deck etc easy with no problems. It didn't, somehow (maybe for better) get WiFi? But I don't really care.

Navigation

[0] Message Index

[#] Next page

Go to full version
Powered by SMFPacks Super Quote Mod
Powered by SMFPacks Menu Editor Mod