Unfortunately this IDA feature doesn't always work as needed especially if you define your objects in Hex-Rays.
If youyour problem is around using Hex-Rays, you can use
the https://github.com/EiNSTeiN-/hexrays-python-plugins/blob/master/xrefs/xrefs.pyXRefs with plugin with the https://github.com/EiNSTeiN-/hexrays-python
API in IDA 6.4.
As far as I understand latest version of IDAPython with support of IDA 6.5 at google code already already contains these bindings in idaapiIDA API module, but it is not fully operational yet (Atat least I'm not succeeded to make it work).