Beyoncé's father, Mathew Knowles, has fired back at recent remarks by rapper Kanye West about his grandchildren, Rumi and Sir Carter, calling them "retarded.