I'm working on SPARC binary in IDA Pro and need to use __usercall convention, but can't make it work. For example, I've tried to use the following function declaration to reflect the fact that the function returns result in register %o0:
int __usercall sub@<%o0>()
But it doesn't work, IDA says "Syntax error near: %". Removing the percent sign from register name also doesn't help.
Does anybody know if that's possible to use __usercall with non-x86 architectures at all?
%
or with an alternative characters such as$
? Also, have you tried starting the debugger to inspect what the register names are? Perhaps that gives clues as to what should go there. I haven't used IDA with SPARC, but it's also possible you need to adjust the settings for the target processor to support a given register representation.