"Child labor" is, generally speaking, work for children that harms them or exploits them in some way (physically, mentally, morally, or by blocking access to education).
A grandfather generally would not be exploited in child labor.