Invisible Man Chapter 5

Why does our protagonist feel his guilt and accepts it? I believe it is because that, although the protagonist had had his share of trials and tribulations, he has not suffered nearly as much as the Founder, and is therefore not entitled to an education. But there is also a moment where he cannot bare to look into the eyes of Mr. Norton, probably because of what he represents, which is the white force he is serving and being submissive to. This would mean he is doing the exact opposite of following the advice his grandfather gave him, and although he is creating an identity for himself, one that will make him an esteemed member of society someday, he is doing it under the white man's thumb.