It should only hang the guy who initiated the retreat effect from what I've seen:

http://www.shadowera.com/showthread.php?24303-Game-hangs-when-ally-with-attached-Heirloom-is-returned