Baljeet is Banjo's twin brother. When Baljeet was about two years old, his parents Agnes and Steve kept his sister while sending him off to live with Mary, his owner who he still lives with to this day. Despite this, he sometimes visits Banjo.
And yes, he's named after the Phineas and Ferb character.