[ale] HPC replies

[Leam Hall]

On 12/30/24 17:50, Russell L. Carter via Ale wrote:
> Yes, exactly so.  This is what I meant by economically inefficient.
> You can be a specialist and employed at say a National Lab. of some
> sort located *not* in an expensive housing city (ie, not NASA Ames)
> and enjoy the work immensely.  I know I did:  if you check out the
> original published NAS Parallel Benchmarks you will find my name right
> there, and that job was the grandest adventure of my life.
> 
> But!!  I don't know anything about SLURM because my own household/small
> biz clusters just can't justify the overhead for *all the other stuff*
> that is required to make such a system viable with a low headcount
> support crew of ahem uno ein un yep *1*.
> 
> I mean it's all cool stuff and if you believe it's for you (it was for
> me at the time) go for it but have no illusions that anybody on say
> Hacker News will understand such a thing.  (That could be a good reason
> to do it anyway, yep I get it)
> 
> Basically the whole cloud ecosystem which is heating up the planet so
> successfully is predicated on *waste*.  Maybe somebody has calculated
> how much of the cloud is simply tests.  You need tests, to be sure, but
> real work is always jobs of days, weeks, months.  What the cloud don't
> care about is efficiency, in the HPC context.
> 
> Good luck and all the best,
> Russell
> 
> Did I just top post... again?  I mean &*^@(*&^#$ Firefox for getting
> rid of the emacs editing ability.

I'll just remove all else and respond.  :D

You, Brian, Vernard, and Jim, became my target audience, although Jim was the only person I knew doing HPC. Vernard, Russell, it is good to meet you!

Much of my career has been on things most technologists don't care about: OS vulnerability scanning, supply chain security, and not dumping 27,315 third-party packages on a node because the STDLIB method isn't the newest or coolest thing. Having done cloud, and even supported an enterprise-specific cloud backend, your opinion seems to match mine. The cloud is flexible, but not overly efficient. Many cloud start-ups don't seem to care what OS is underneath, they just want their app to run and keep running. Which is a fine thing! If it pays the bills for them and adds value to the world, then more power to them.

I have a chance at an HPC job. During the interview I was honest about what I didn't know, even admitting that I had to do a web search on "Slurm". I like to think I can learn, given a task list, but with HPC "I don't know what I don't know". Hence the original question. I chased the "AppDev" career path for a while, and while I like playing with code, front end development just isn't my joy. I like Linux, I've built a career supporting it, and HPC seems like a cool path.

One of the things I'm looking forward to is not being the smartest person in the "room". Which is funny, as I'm not particularly smart. I've just been doing this for a long time and enjoy learning more about whatever I'm doing. If I can get into an HPC shop I'll have a lot to learn and smart people to learn from.

So I'm hoping and praying for the job; we'll see what happens.

Thanks!

Leam


-- 
Linux Software Engineer   (reuel.net/career)
Scribe: The Domici War    (domiciwar.net)
Coding Ne'er-do-well      (github.com/LeamHall)

Between "can" and "can't" is a gap of "I don't know", a place of discovery. For the passionate, much of "can't" falls into "yet". -- lh

Practice allows options and foresight. -- lh