Computational notebooks are great, but only seeing what the author (or coder) wanted you to see is not enough to evaluate their work. In addition to data and code, we need to see the path they took, the exploration and experimentation that led to the final presentation of ideas in the notebook.
For this we can use cloud based environments controlled by funding agencies/universities that ensure every interaction with data is recorded from the very beginning.
Something like this would at least reduce the risk of p-hacking practices that would otherwise be there even if everyone used notebooks instead of papers.
For this we can use cloud based environments controlled by funding agencies/universities that ensure every interaction with data is recorded from the very beginning.
Something like this would at least reduce the risk of p-hacking practices that would otherwise be there even if everyone used notebooks instead of papers.