Doesn't sound like a whole lot to worry about. You were living together for less than 3 years, and apparently no Habitation Agreement was signed. Futhermore, I think your partner is in error. Small Claims Court is designed to handle CIVIL disputes over personal property and debts, not FAMILY disputes. I think he means Family Court, which also deals with common law breakups.
In your case, we have a manipulative controlling man who, as a means of obtaining and retaining control over you, gave you a number of gifts. The fact that they were given as gifts indicates nothing was expected in return, Moreover, things like vacations, health care and car repairs are not personal property gifts like jewellry or cars, since it's impossible to effect an ownership transfer to recover them. Nevertheless, as you can see from the link below, actions can still be brought over things such as gifts. But my guess is that since the exploitation came from the other party, any reasonable court would find in your favour. Besides, there seems to be little probablity the gifts given to you would satisfy the criteria of a "constructive trust" (explained in link below).
As an aside: I think it might be important to document the person's manipulative behaviour and present that as part of the defence if it ever goes to Court. I doubt if it will, because the guy is unlikely to find a lawyer stupid enough to handle such a case. But who knows, it's a crazy world out there.
Another case of abuse I was involved with concerned a Chinese Lady. I knew her partner received a criminal conviction for spousal abuse in the past. So I went to the court house to get a copy of it so that she could bring it to Court to undermine his credibility, should he contest the civil proceeding. He didn't. (I was only able to do that because I knew the Court House involved, and was able to get a copy of the conviction.) I have to wonder if the guy you were involved with also has some stuff that would undermine his credibility
See the issues involved in interpreting how gifts and personal property are handled in the event of a common law termination in the link below:
http://www.ontariodivorces.com/division-of-property-commonlaw.html
Also, here is a guide to the Family Law Act. Read the pages that pertain to your former common law relationship. It should give you some background for any defence you might have to present to the Court.
http://www.attorneygeneral.jus.gov.on.ca/english/family/familyla.pdf