## How often do people read the work that they cite?

### Remember to vote up questions/answers you find interesting or helpful (requires 15 reputation points)

I have the following question:

How likely it is that an author carefully read through a paper cited by him?

Not everyone reads through everything that they have cited. Sometimes, if one wants to use a theorem that is not in a standard textbook, one typically finds another paper which cites the desired result and copies that citation thereby passing the responsibility of ensuring correctness to someone else. This saves a lot of time, but seems to propagate inaccurate citations and poor understanding of the work being cited.

The question is thus about what should authors' citing policy be, and to what extent authors should verify results they are citing rather than using them as black boxes.

-

2
Okay, I'll split it. – Vidit Nanda Jun 4 at 23:11

2
The comments to this question mathoverflow.net/questions/43147/… may be of help. – Joel Reyes Noche Jun 5 at 10:02

1
Perhaps the question could be edited to have a more neutral tone? – Joel David Hamkins Jun 6 at 14:32

1
Joel, it is community wiki and you certainly seem to have enough reputation. Maybe you should just edit it to your liking? – Vidit Nanda Jun 7 at 15:01

1
Related question: mathoverflow.net/questions/23758/… – Timothy Chow Jun 15 at 15:40
show 8 more comments

## 10 Answers

It depends whether I am citing the Poincare Conjecture or the five lemma. But I agree that either way, one should understand what one is doing well enough to use a result properly.

-

1
I picked the Poincare Conjecture for a few reasons: (1) it has been carefully checked; (2) the probability is 0 that an error got past the experts, whereas I would find that error; (3) the statement looks to be very useful even to people who don't know its proof; (4) it would be an insane amount of work for most people, if they could do it at all, to check the proof. The five lemma is a different story, though I suppose I'm not sure who is originally responsible for developing/discovering it. – tweetie-bird Jun 5 at 15:40

### You can accept an answer to one of your own questions by clicking the check mark next to it. This awards 15 reputation points to the person who answered and 2 reputation points to you.

This may vary depending on the field you work in and what kind of papers you're writing, in addition to your personal style as a mathematician. I mean whether you bother to check the details of a citation probably has a lot to do with how much effort it costs you. In my line of work the citations are usually to other papers within my area of expertise and I do in fact try to look pretty closely at what was done and whether it really gives what I need. But there have been times when I needed something outside my comfort zone and was content to take the word of an expert that so-and-so's theorem did the trick.

On the point about propagation of errors, it seems to me that there is a sort of correction mechanism. If a result is being cited incorrectly, eventually it may lead to a contradiction which would then be unraveled by tracing the problem back. Does anyone have any examples of something like this actually happening?

Oh, I should add that some portion of my citations are "courtesy" citations along the lines of "so-and-so did something related". I'm afraid to say in cases like these my reading of the cited paper will sometimes have been very superficial.

-

17
I do have an example of "correction mechanism". Working on a paper based on a published result, we were able to prove something "too strong". (Namely, we almost had $\mathsf P\neq\mathsf{NP}$.) We then were able to find the error in the cited paper. The problem was that the cited paper itself cited an older result, but forgetting some genericity hypotheses. Therefore, the result was possible to repair by adding some genericity conditions in it too. Yet, the correct version does not imply anything interesting with regards to our original question... – Bruno Jun 5 at 6:50

1
Very interesting! – Nik Weaver Jun 5 at 12:37

I normally do. Right now I'm facing a tough choice though: to read David-Semmes book in honest or to write something like "We prove that A implies B. The reader can juxtapose that with the claim on page ... in [] that B implies C" instead of "We prove that A implies C" in the introduction. Being as lazy as I am, I am inclined to go for the second option but that will certainly make the paper less "sexy", so my co-authors do not feel very happy about it.

However this shows how you can avoid both reading the papers you refer to and the uncertainty about whether what you declare proved is actually proved: separate the part you prove from the part you refer to in a crystal clear way and take credit for the reduction only rather than for the full statement (which, frankly speaking, is as much credit as you can really claim anyway).

The correction mechanism Nik mentioned works primarily in the way that most things just go unnoticed because nobody reads those papers or uses them in any way. When something is really important, it gets a lot of attention and somebody finally straightens things out. However, that doesn't happen fast and I have learned it hard way. My 2002 Duke paper joint with Treil and Volberg on the system Tb theorem has an error in the proof. It had been cited a lot of times before the error was finally spotted and corrected by Tuomas Hytonen around 2010. This also shows that an erratic argument isn't always useless or fatally flawed. Sometimes it is just an "incomplete proof". To my shame, I should also mention that it was one of the cases when I didn't read the final draft carefully and relied on my co-authors to do that. Apparently, they had a similar attitude...

-

Mostly, I read those part of the papers that I need to cite in my works. Sometimes though, I read them almost completely before starting the paper (to get some ideas and learn the techniques). There are also occasions that I read only a few pages of the paper before citing it.

-

Often not, and for lots of different reasons.

Citations about related work, background information etc. are often given to give the reader the context of your work, but your work does not necessarily depend on the results therein.

Seminal results from decades ago are sometimes in German, French or Russian, and while I might occasionally struggle through papers in the first two languages if I desperately need to see how something was proved, I will usually take the results on trust, especially if they are heavily cited.

And then, some results are just too complicated, but are sufficiently well accepted that there is really no choice but to rely on them - most group theorists will use the Classification of Finite Simple Groups when necessary, but few, if any, will understand the full details of the entire proof. On similar lines, I cannot possibly read the Robertson-Seymour series of papers on Graph Minors. Yet I believe the main results in them, and if and when I refer to the fact that any minor-closed class of graphs has a finite set of excluded minors, then it is pretty much obligatory to refer to the relevant paper in the series.

If correctness is seriously in doubt, then it would presumably be necessary to work back not just to the papers you cite, but to the papers they cite, and so on.

-

As for finite simple groups or similar deep theorems: There are more than two options. For example, you might want to use some ideas in the proof and adopt them to a similar situation, or you even want to generalize them, modify them etc ... of course then you have to go into the details and should also present them to the reader of your paper who is not familar with the cited paper. – Martin Brandenburg Jun 6 at 16:49

We are more inclined to read the details when we are young, for several reasons. First, because we are more energetic than when getting old. Second, because we are a little bit idealistic, while everything tends to become relative after we have seen all kinds of behaviors in science. Last, because we are often single-minded at the beginning of our career; we do not have too much to read and we are not disturbed by administrative duties.

Of course, It is of great importance to have a clear and complete understanding of the papers that we cite. This is why young mathematicians play such an important role.

-

16
I must add, as a young mathematician, that since we know less than our more experienced colleagues, reading papers carefully is the only way to be sure that you understand it correctly. – Andrei Smolensky Jun 6 at 9:51

1
@Andrei: perfectly right. – Denis Serre Jun 6 at 12:15

3
Yes, eventually this idealism just fades away ... – Martin Brandenburg Jun 6 at 16:52

I like papers with big reference lists. Sometimes these citations lists are even more useful for me than papers themselves, since I can find some others papers. And this describes context and rises new questions for further work.

So since I like big reference lists in papers by others, I also try to include many references, 95% of them just "someone have done something related", and of course I do not read carefully such papers, just may be understanding what question has been asked and what is the context of this question.

However there are some (I remember 2) cases where I need to heavily rely on the results by others without deep checking the proofs (since it would cost too much effort). I do not like doing so, but my experience says me that it should sometimes be done.

In general I think it much depends on the area you work, in my field it seems to me simple useful constructions are valuable, rather than complicated proofs.
I like what Igor Pak wrote here : http://mathoverflow.net/questions/85269/presenting-work-in-progress/85283#85283

let me quote: "For example, in Enumerative Combinatorics and Discrete Probability, two areas close to me, these priorities are sort of opposite. In the former, there are very few open problems. A nice new formula or a new bijection construction, even if only conjectured and checked by a computer, is already a lot of progress. Once you convince yourself that you can finish the proof, you can start giving talks - people will trust your judgement.

However, in Discrete Probability, there are lots of open problems and conjectures, often delicate and technically difficult. I would advise NOT to speak about your results until the proofs are fully written and carefully checked by somebody. This might work once or twice, but eventually there will be a seemingly trivial mistake which you overlooked in the first draft. Unfortunately, often enough such mistakes can completely destroy your proof."

So I think in the first type of areas deep checking is not relevant, but in the second it is very necessary. (In my (subsub)field situation is like 1, which makes my life more easy).

-

I think it was Thom who said was that it was immoral for a mathematician to base his work on results he/she did not understand. Sometimes I think this attitude would kill off whole areas of research, but it is probably the way to go. In my case it makes a difference if I need someone's work for to prove a neat corollary or as an argument in the proof of a main result.

-

3
I think that this statement is far too general to be universially true. For instance, would it be immoral to use Fermat's last theorem in order to prove something just because you do not understand what Weyl was doing in order to prove it? I think that using a result that is accepted to be true by basically everybody is no immoral. In fact, it would be immoral to not publish a great result just because you need a result for it that you do not fully understand. – Sebastian Jun 6 at 9:51

4
It all depends on the meaning "results that he/she did not understand": Taken literally, this just means "results whose statement (s)he does not understand", which is a perfectly reasonable viewpoint (although, personally, I would not call it "immoral", just "wrong"). If you add the word "proof" in this maxim, then, I would argue that such sentiment was still quite reasonable 50 years ago, when one could understand pretty much any proof from any area of mathematics after spending few months on them. Things changed since then (classification of finite simple groups is another good example). – Misha Jun 6 at 12:41

2
It was Wiles (of course), sorry about that. At least I got Fermat right. – Sebastian Jun 6 at 17:28

2
@Sebastian: Of course the statement is somewhat exagerated, but it is nice to understand things and to explain them correctly after one has understood them. There is to me a marked difference between a paper where an author tries to communicate something (s)he understood and a paper where someone is trying to plant a flag and tell the rest of the world "this is MY theorem". That said, I love to read and digest ideas, so I agree somewhat with Thom not because of moral reasons, but because it brings me pleasure to read a good paper and to make contact with another mind. – alvarezpaiva Jun 6 at 18:05

6
@Misha: You are right in that it is impossible to understand all proofs, but I think that in many cases we can borrow a nice technique from the "Russian school": one can at least try to understand the proof in some simple, but representative cases and master enough examples to feel that the theorem is "right". – alvarezpaiva Jun 6 at 18:08

If it is a recent or not so well known result I am citing then I read completely to make sure it is correct. If it is a well known result that is in essentially any relevant book then it would be enough to know that the result is there and the exposition is good.

-

[offtopic] Since I cannot comment, let me just throw in an old story I heard from my professor. Some time back, a paper by Einstein and Preuss was being cited all around. Now, we all know some names that collaborated with Einsten, but this Preuss is kinda unknown. Turns out that the journal name of the reference

Einstein, A. (1931). Sitzungsber. Preuss. Akad. Wiss. ...

after some citations, got to be promoted to coauthor. NICE! Here's some (german) reference: http://de.wikipedia.org/wiki/S._B._Preuss

Now just to account to the statistics, I know some people that skip the reading of some papers to present seminars and talks, but I think they do check the stuff before writing something up. As to me, I try to read some stuff and then check the references and references of references until I give up. But that doesn't matter, since I'm far from publish anything at all, as it seems. Cheers.

-
{"extraction_info": {"found_math": true, "script_math_tex": 0, "script_math_asciimath": 0, "math_annotations": 0, "math_alttext": 0, "mathml": 0, "mathjax_tag": 0, "mathjax_inline_tex": 1, "mathjax_display_tex": 0, "mathjax_asciimath": 0, "img_math": 0, "codecogs_latex": 0, "wp_latex": 0, "mimetex.cgi": 0, "/images/math/codecogs": 0, "mathtex.cgi": 0}, "config": {"markdown_headings": true, "markdown_code": true, "boilerplate_config": {"ratio_threshold": 0.18, "absolute_threshold": 10, "end_threshold": 15, "enable": true}, "remove_buttons": true, "remove_image_figures": true, "remove_link_clusters": true, "table_config": {"min_rows": 2, "min_cols": 3, "format": "github"}, "remove_chinese": true, "remove_edit_buttons": true, "extract_latex": true}, "english_confidence": 0.970703125, "perplexity_flag": "middle"}