Unfortunately this IDA feature doesn't always work as needed especially if you define your objects in Hex-Rays.

If you problem is around using Hex-Rays, you can use 

https://github.com/EiNSTeiN-/hexrays-python-plugins/blob/master/xrefs/xrefs.py
with 
https://github.com/EiNSTeiN-/hexrays-python

in IDA 6.4

As far as I understand latest version of IDAPython with support of IDA 6.5 at
google code
already contains these bindings in idaapi module, but it is not fully operational yet (At least I'm not succeeded to make it work).