Introduction to Genomics for Engineers

242 points14
glofish9 hours ago

Those looking for a proper and comprehensive introduction into genomics from a programmer's perspective should try the Biostar Handbook:

I have learned so much from it.

It is an introduction into what is like to do genomics in a scientific environment. The content at the link the OP posted appears to be an oversimplified, high level and naive overview

Ultimatt39 minutes ago

The opening paragraph of this resource states its absolutely not about being a comprehensive introduction to genomics. I strongly disagree with the sentiment its naive or oversimplified. It's trying to give someone with no knowledge a working mental model to begin to dig into building a comprehensive view. A framework of analogy for many people is an extremely helpful device for learning, frequently left out by comprehensive scientific or engineering texts.

gravelc7 hours ago

This is indeed a far better resource.

faizshah7 hours ago

One of my favorite books in this space is “BioInformatics Data Skills.” It’s just nice concise coverage of a lot of basic tech skills like git, bash, tmux etc. and then coverage of basic bioinformatics skills.

For me coming from a SWE background the computational skills are very easy to pick up especially if you work with bioinformaticians you can ask questions. It’s the genomics knowledge that is very difficult for an engineer to acquire.

ramraj079 hours ago

Starts with “ This Guide is written specifically by and for computer scientists and engineers”

And yeah it shows - contrived example after another, and honestly not a great description of anything.

If you want to truly understand genomics you have to understand how biology works. And honestly it’s great info for anyone even if you’re not getting into genomics or whatever.. why would you not want a working model of how life is put together? In that case I’d just recommend dusting off a biochem or cell bio text book and reading just the first 5-8 chapters. Typically they lay it out very simply from basic principles and the authors have far more experience and understanding and writing help than this weird tutorial course thing.

ArchD5 hours ago

Do you have an example of a contrived example and explanation of why it is contrived, for the non-biologist to see why it is contrived?

I once tried reading a few chapters of a bioinformatics book explaining DNA, RNA, protein creation, etc. The basic idea seems very simple but to my mind they explained it non-systematically with too many words. There seems to be an internal information structure in these RNA- and DNA- related processes that was not being concisely presented and it seemed that if the writers presented the material in terms of computer-science concepts, so much time could be saved.

gravelc3 hours ago

You can't present it as computer science concepts because it's not computer science.

For example, the central dogma of DNA transcribed to RNA translated to protein seems simple, but it's not.

In almost every instance, there are vague 'rules' and many many exceptions to these rules. For example, often coding regions in genes start with an ATG, but sometimes they don't. Sometimes splice sites (where the non-coding parts of transcripts called introns are chopped out) can be predicted, but a portion of the transcripts are not spliced at predicted sites for no obvious reason. Sometimes the predictions are just wrong. Sometimes the generated proteins are modified at specific locations which impacts their function, but again, sometimes not. Even whether the gene itself is 'switched on' (i.e. able to be transcribed) is impacted by many many things, such as unidentified transcription factors, or whether the chromosomal location itself is accessible or not. There are many many other things that impact the process.

There is no simple underlying concept as the system is not designed, it evolved and is quite different among different organisms, and even in different tissues or timepoints in the same organism. As long as it works and provides enough benefit to avoid negative selection, that's enough.

It's a mess, which makes it interesting.

ramraj072 hours ago

It starts by defining a cell as a bakery. First of all, what exactly is more systematic in comparing a cell to a bakery? Other than the fact that both things produce crap the analogy has no real substance. And there are so many wrong facts in that one paragraph (many of our genes are present as more than two copies in our genome, for one).

You are absolutely correct, there’s an information theoretical underpinning of genomics and systems biology that’s rarely if ever tackled in text books but (a) neither does this course tackle it, and (b) you can’t just skip on biochem basics and Jump to that. That’s like trying to become a physicist without learning math.

noipv44 hours ago


There's nothing about sequencing by synthesis, how blocking nucleotides are added one after another, pictures of the fluorescent nucleotides on the flow cells are image analysed, etc.

This site looks like an ELI5 kind of treatment.

User234 hours ago

H-bonds! It's totally h-bonds all the way down.

Amusingly that's literally like 80% true. Water is just a really big deal in biochem.

civilized12 hours ago

Really glad to see this, but it reminds me of the earlier HN post that said engineers don't go into genomics because it doesn't pay and requires a lot of investment in learning biology.

conradev9 hours ago

If you want some personal motivation to get into genomics, you can get your whole genome sequenced for a few hundred bucks and play around with the raw files yourself. I used Dante Labs[1] and they are great. You can even ask them to delete your data and samples!

[1] –

glofish7 hours ago

and you will learn almost nothing from sequencing and studying your own genome

at best you waste your time, at worst you will find all kinds of things that are not there

it is the Silicon Valley hacker mentality that thinks the life is some sort of computer where you can fiddle with parameters

learn some biology first, then you can marvel at it and realize just how absurdly simplistic is to think you can read anything out of some random letter

conradev6 hours ago

I am not out here reading SNPs like tarot cards.

I wanted to play around with BAM files and it is much more engaging to play around with my own BAM file versus downloading one from a website.

It is also about data ownership. The value of a fully sequenced genome is limited, sure, but I still want that value without having to give my genomic data to 23andMe.

ackbar031 hour ago

> and you will learn almost nothing from sequencing and studying your own genome

But Dante labs sure will!

zosima11 hours ago

Working with genomics technology is too far away from the money to become rich from. There are too many middlemen in-between technology and application.

But it's a fun subject, and as the technology develops, middle layers will disappear and then the money from expertise will become better.

The number of people that are both capable software developers and has a good understanding of cellular biology are quite few and will probably remain so for the foreseeable future.

jltsiren10 hours ago

I don't think middlemen are the issue.

In biotech, the end goal is a physical product or a service performed by a doctor or another highly paid professional. Those don't scale as well as software. The ratio of users to developers is also low. You are likely developing software for many niche tasks, which does not scale either.

And if you are considering roles in the academia, your productivity is not going to be high enough to justify a competitive salary. Productivity, in monetary terms, is defined by the amount of money you can bring in. Either directly on indirectly. In the academia, that usually means grants. You may be able to argue successfully to a funding agency that one software engineer is worth two postdocs, but not four.

bsder11 hours ago

The reason why San Diego has such a craft brew scene is that it has a lot of underpaid microbiologists.

mbreese10 hours ago

The people studying yeast metabolism in grad school were always the ones with the best beer (especially the ones that created mutant strains). I think the two might be related.

dekhn9 hours ago

One of my gateways into Making was during grad school when my housemate brewed beer. He wanted to make a counterflow wort chiller, went to Home Depot, bought some parts, assembled the whole thing, and it worked perfectly. I was completely blown away you could make "scientific" apparatus from Home Depot. And immensely jealous.

mbreese8 hours ago

Heh. That reminds me of the time in grad school where I needed a liquid disposal system for an arraying robot. We had this great ($$$) robot, but the liquid waste needed to be manually emptied every few hours. It was non-toxic and just went down a sink.

A quick trip to Lowe’s to get PVC fittings and pipes, and I suddenly made my own scientific equipment and saved me some time!

supahfly_remix9 hours ago
firstplacelast12 hours ago

^Most recent discussion I’ve seen.

I worked in genomics, left this year because you’re underpaid and often disregarded “IT-help” that assists wildly over-educated and underpaid people driving the actual research in 95% of cases.

tetris1112 hours ago

Thats why you stay though, the people are interesting and the work is meaningful and you directly see the fruits of your labors whilst contributing to a codebase that is by default open source.

firstplacelast11 hours ago

People aren’t anymore interesting than anywhere else.

Work is no more meaningful than anywhere else. It’s a big “selling point” for the industry, but it’s just a way to get people to get paid less (yay you’re making the world better than all those garbage people serving coffee or healing sick people or keeping your lights on or optimizing the routes of the goods you have delivered). If you want sustainable systems, trying to be a martyr and work for less only screws this up long term.

Code-base is not open-source. It’s biotech R&D, there is zero culture of sharing outside your organization within industry. You can present high-level things at conferences and such, but you’ll have to rip the raw data out of their dead hands…not happening.

I’ve been in too many conversations about building software to serve larger groups in this industry. It can happen, but it can’t currently and nobody wants it. Confident someone will find a solution, but everyone wants their own home-grown solutions in their own walled-gardens that no one has access to.

Data and the things it can/can’t tell you are held tightly in these companies. I was at a pharma a couple years ago where researchers were explicitly told they COULD NOT test certain compounds in a certain way because they did not want a trace of this data to exist while they were trying to push compounds through the FDA.

tetris111 hour ago

On I assumed we were talking about being a software eng in academia. It's a spiritually rewarding experience, with none of the blackholes you've described at pharma

fncivivue711 hours ago
ramraj079 hours ago

There are a lot of starry eyed individuals who are ready to “sacrifice” stable welll paid career to “make a difference” by working on fields like biology.

Then there are also engineers from XKCD 1831

wheresmycraisin9 hours ago

You basically end up with the salary of a helpdesk person at a university.

dddiaz111 hours ago

I have absolutely loved working in genomics. I am a huge believer that genomics will be a huge part of healthcare in the future, and i have two examples to motivate that point that I think may be interesting to the reader.

1) The Moderna vaccine was made with the help of illumina genome sequencing. They were able to sequence the virus and send that sequence of nucleotides over to moderna for them to develop the vaccine - turning a classically biology problem, into a software problem, reducing the need for them to bring the virus in house.

2) Illumina has a cancer screening test called Galleri, that can identify a bunch of cancers from a blood test. It identifies mutated dna released by cancer cells. This is huge, if we can identify cancer before someone even starts to show symptoms, the chances of having a useful treatment dramatically go up.

Disclaimer: I work for illumina, views my own.

I wrote some more about why genomics is cool from a technical point of view here (truly big data, hardware accelerated bioinformatics) :

mtlmtlmtlmtl9 hours ago

The thing I'm most excited about long term is biocomputing.

Having Turing complete programmatic control over biological systems has an absolutely endless list of transformative applications.

Imagine being able to program bacteria that can "infect" the patient and attack tumor cells, or act as fodder to keep autoimmune disease in check.

Or let's say we could program stem cells into "liver repair mode" to go and differentiate into new liver cells.

Then the implications for things like drug synthesis with the ability to programmatically control enzyme levels to compile more or less arbitrary biosynthetic pathways into fast growing photosynthetic algea, turning CO2, water and sunlight into medicine.

It's still a long way off being at that level of applicability, but man oh man it's gonna change everything.

tombakt7 hours ago

Sounds great until natural selection kicks in, and because DNA replication is largely a lossy process, suddenly the thing you programmed the organism to do mutates to do something else a whole lot more problematic.

Imagine a software heisenbug, but instead it's a life form that you can't kill -9.

The idea of tailor-made medicines in a vat is awesome, but as far as creating a bacteria to "specially target" certain cells seems like a disaster waiting to happen.

mtlmtlmtlmtl7 hours ago

Those are certainly real problems, and I'm not a cell biologist, but I'm not convinced these problems are insurmountable.

For instance, it might be possible to use ECC to get around transcription errors. It could also perhaps be ensured that any rogue "clinical biocomputer" could be easily treated with antibiotics or specifically engineered bacteriophage virus.

Like I said, the technology is very far off from having real world applications like this. At the moment it feels like we're in the analogue of the 40s and 50s for conventional computing. The field is still just inventing the very basic building blocks. It's going to be very limited in use, wildly dangerous(look up mercury delay lines) and unreliable for decades to come.

agumonkey10 hours ago

what kind of math/cs/algorithmic skills do you think one should work on to get a job in this kind of company ?

pinkwinds10 hours ago

Purposefully blocked for certain countries?

"The Amazon CloudFront distribution is configured to block access from your country."

crispycas128 hours ago

TBH I'm surprised how hard Illumina is already pushing Galleri as a product. Current ctDNA/cfDNA are imperfect for advanced cancers which should have a lot of shedding to begin with. Additionally CHIP is and outstanding issue. DNA methylation sequencing has promise but I feel more data would be needed to truly make diagnostic findings. So to see Illumina market it as a ready to go product is quite worrying. It may burn a lot of people

gravelc7 hours ago

Don't want to be too disparaging, but this to me doesn't seem to be an 'Introduction to Genomics', but more an introduction to read mapping and variant detection in human (or more broadly diploid) genomes.

Genomics stretches vastly beyond this - assembly and annotation to start with.

I'd argue the most interesting problem space for software engineers is outside of what is covered in the document.

lordofgibbons6 hours ago

I find the field extremely interesting, but I wish the pay in genomics was better. Compared to fang/unicorn type companies, their pay is way below market and it's really hard to justify the massive pay cut.

f6v2 hours ago

> their pay is way below market

The pay is exactly where market is. There’re ton of wet-lab people wanting to get into “data”. And the industry is less lucrative than showing ads like Google does.

nextos2 hours ago

I think Calico (Alphabet) pay is not too far from a SWE at Google. However, this requires a PhD and much more experience.

yuppiepuppie11 hours ago

Genomics is where I started learning how to program. Having worked as bench scientist in a genetics lab I understood nothing about my lab mates research when they were showing me python scripts of their analysis. Which initially got me curious. Now having been in the in the industry developing apis for large companies for the past 8 years, I’d be keen to get back into it. Any ideas where to start or find jobs in the space? I would love to go back into the space.

chairhairair11 hours ago

I have a similar story with chemistry. I’d also like to get back into the sciences, but I’m not sure how relevant programmers are.

feet9 hours ago

Very relevant and becoming moreso. Check out job postings at research institutes and universities with healthy research departments

zelphirkalt8 hours ago

How does one know, whether they are healthy or not?

feet5 hours ago

Generally if they are producing consistent, high quality research

qualudeheart4 hours ago

Does this touch on recent developments in information biology?

penciltwirler12 hours ago

Nicee, but I feel like really the only thing you need to know as an eng is DNA -> RNA -> Protein. Sometimes RNA -> DNA via reverse transcriptase. Everything else is just normal Python scripting.

janeway9 hours ago

Oh no. A major flaw that kills protects; to run a valid statistical test you need to understand the underlying reality of the data. Otherwise you just run tests until you find “something”.

How do you handle one genomic variant affecting dozens of different rna transcripts and isoforms? How do you handle tissue-specific expression? LD haplotype blocks? Frequency across populations and reference choice? Sample handling affecting read depth? Mixed direction of effects in phenotype-genotype? The critical (and beauty IMO) feature of bioinfo is requiring an understanding of how your dataset can rarely be considered clean and as simple as _observation name_ and _observation value_. To succeed it is usually critical to know a lot about the observation meta data which is not collected in the dataset. Hopefully in the future it will be better curated and less esoteric.

epgui11 hours ago

I’m a biochemist + software engineer, and while I understand where you’re coming from, IMO that’s a very harmful/self-sabotaging attitude.

As soon as you start touching science, everything is important.

greazy11 hours ago There is more to genomics than python scripting. This is widely incorrect assumption.

A new generation of bioinformaticians and computational biologists are using rust, go, and the web to create, share and deliver.


joshuahedlund6 hours ago

That’s what I thought too until I learned about

- the dna that doesn’t code for proteins but makes up the vast majority of human dna

- the intron regions of genes that are translated into RNA but then sliced out of the RNA and not transcribed into protein and are 5x larger than the coding parts

Those two things alone are absolutely critical to understand to interpret a genome sequence. Of course there is much more.

aquafox11 hours ago

You do know that there are things like epigenetics, DNA repair (using specialized proteins), RNAi, post-translational modifications, metabolites (just to name a few)?

gravelc7 hours ago

Who knew complex large polyploid genome assembly (i.e. sugar cane) was just a matter of python scripting?

otherme12311 hours ago

Sooner or later you'll have to learn all the other stuff in the linked page: file formats used only in genomics, structural variants, NGS, evolution, regulation, polygenics, etc.

ALittleLight10 hours ago

I didn't get this from skimming the first page - but what will this let me do? If I take this course will I be able to mess with a cell or will I just learn some stuff about biology.

I saw a recent Lex Friedman podcast where the guest talks about "bioelectric patterns" and somehow getting a worm to grow a second head by messing with those patterns. I would absolutely start on this course now if it was a realistic pathway to doing something like that.

pgayed9 hours ago

This is the worst outcome of regulation of the life sciences.

There is no REPL for the cell. No tinkering allowed.

When Marvin Minsky was growing up in New York, neighborhood pharmacists owned fluoroscopes. He said those fluoroscopes were like “great black boxes” to him and that “those kinds of black boxes don't exist for kids anymore.”

dekhn7 hours ago

Many modern bio experiments are almost exactly a repl. You build a system and then repeatedly interrogate it inputing some data using a Read (IE, you pass in some DNA), which is then Eval'd by the cell (warning: there will be side effects), "printed" in the form of some signal like a fluoresence, and then you loop back to the beginning. This is often called "closed loop laboratory."

Unfortunately, each step ends up being extremely challenging, and there's tons of noise, and the cost of each Read, Eval and Print is far higher than in a programming language. Further, the "system" is running 38,000 other "threads" all of which have direct read and write access to your data, some of those threads consider your data to be the enemy and cut it up, while others are just randomly spamming your console with uneccessary debug log messages.

We have actually reached the point where some scientists have synthetically created a novel chromosome, and used a preexisting cell to bootstrap the new genome so that the cell eventually contains only protein from the new genome. To me, that represents a step beyond tinkering: it means we can create synthetic lifeforms with exactly and only the details we want, which makes studying them and engineering them far easier.

Interestingly, even though this tech exists, nobody has found any interesting use for it and it's not even really used to probe biology.

A better example would be gene therapy, which has been developing slowly over decades. A single person died in the a trial in the 90s and stopped development (that's the regulation part you're referring to) for decades. In other trials that don't include gene therapy, patients routinely die and they're just a statistic.

ALittleLight7 hours ago

What is the minimum it would take to run such a REPL at home? What hardware, life form, and knowledge would you need, at a minimum, to start making changes and seeing results?

f6v2 hours ago

You’d need to build yourself a generic molecular biology lab. The investment is huge.