What if the missed segment is very very long, if the chicks get into a blob for a long time the user is going to have to make a very substantial amount of clicks in order to add points for each and every chick.
I would say there must be an effective way to develop a method so that if the coordinates of the un-tracked segment are "close" to the tracked segments the software would know.