Yes, people can develop a "tolerance" to a previously sensitized food. If the antigen (in this case dairy) has been removed for a significant amount of time (variable amongst individuals), the body may no longer mount an IgA/IgG antibody response.
To learn more about the lifespan of IgA and IgG antibodies, please view the Food Immunoglobulins handout.
