Is there a way to get the count of objects currently hold by ObjectManager?

No elegant way, just a workaround that is subject to break in future versions:

type
  THackObjectManager = class(TObjectManager)
  end;
...
ObjectsInManager := THackObjectManager(Manager).ObjectMap.GetList.Count;