You certainly can keep generating an infinite number of pseudo-random numbers, but as a side note, eventually the sequence will repeat and you will start getting the same sequence of numbers again, because of the algorithm used to generate the numbers.
However, this will only happen after many billions of numbers, and as a practical matter, it shouldn't affect any Java code that you write...