Saltar al contenido

How to know if your bioinformatics provider is reproducible

When a laboratory outsources an analysis, it almost always ends up worrying about the same thing, and it is almost never the price. It is the question of whether someone else will be able to repeat that analysis a year from now. Five questions you can ask any provider before signing.

The objection that always comes up

The same complaint comes up in industry forums: you get pretty tables and there is no way to know how they were obtained. Some people put it like this, and they put it in writing because it has already happened to them: «I documented every input» so they could defend the result.

An analysis that no one can repeat does not count as a result. It is an opinion in table form.

Five questions for your provider

1. Will you hand over the scripts and the versions? A result without the code that produced it is unrecoverable. The minimum is the scripts, the version of each tool and the parameters used.

2. How do you validate the pipeline? A pipeline that «works» is not validated. The question is whether they have compared it against public data with a known answer, with the success criterion fixed before looking at the result.

3. Can you run it again in 12 months? If the answer depends on someone remembering what they did, the analysis is not reproducible. A container with the frozen version solves this.

4. What happens if the data are not clean? Ask them whether they reject samples and on what criteria. Anyone who accepts everything without looking at quality is passing the problem on to you.

5. Where are the data processed? If you work with patient or client data, it matters that they are processed in the EU, with a data processing agreement.

Warning signs

  • «I will send you an Excel with the results.»
  • They cannot tell you which version of which tool they used.
  • They cannot show you any case validated against reference data.
  • The price per sample is so low that there is no margin to review anything.
  • They promise you a diagnosis. A bioinformatics analysis gives variants and evidence; the diagnosis is made by a physician.

What we do

We deliver scripts, container and versions, along with the result. The parameters are documented and quality control is done at every step.

The validation is published and downloadable: eight services compared against public datasets with known ground truth, with the success criterion frozen before measuring. The eight passed, and the document also includes what went wrong along the way: nine software corrections that came out of the validation.

We work as a technical report for research and professional use. The data are processed in the EU, with encryption and a processing agreement.

If you are choosing a provider

Use the five questions with whoever is in front of you, us included. If any answer does not convince you, that is your decision.

You can also calculate the budget for your project in a minute, with the published prices and an itemised breakdown ready to send.

See the validation (PDF) → Talk to a specialist

Who writes this

Bioinformatics team at OmicaLabs. We have run our own laboratory since 1978 (ISO 9001:2015, ES147645-1), analysing sequencing data for research and clinical use. We publish our prices and the validation of our pipelines.

OmicaLabs