This paper would explain the sense theory of Frege which contains the definition and its limitation, but mainly focus on “symbol”, “sense” and “referent” and their relationships. Then it will further compare the sense theory with relevant cognitive linguistics knowledge from the perspectives of the definition of sense, its relationship and its explanatory capacity of context to help people understand more about the sense theory.