How to remove erroneous ppa?

I've referred to what you call 'ppas' as 'repositories' below.

Firstly, a word of warning: if you replace the core repositories, such as those listed in your apt-get output, with more up-to-date ones, you'll create havoc in trying to install or update anything, because of the difficulty in sorting out differences between older system libraries/core components and newer ones. Unless you're certain you know what you're doing, it's better just to do a fresh install with an OS built to use the relevant repositories. Furthermore, unless you've checked that they are free software only repositories, many distros throw together free and non-free programs in their repositories. Adding such mixed ones defeats the point of using a libre OS, and puts you at risk of many forms of unethical mistreatment.

With that caveat, it's fairly simple: the repositories apt uses are listed in /etc/apt/sources.list. Open that file with root permissions (enter "sudo gedit" without the quotes in the terminal), remove whatever entries you don't want, put any new ones you do one to a line, and save it. Then run an apt-get update to update the package database.

According to the "Languages" subsection of 'man apt.conf', I would try this command:
$ sudo echo 'Acquire::Languages=none;' >> /etc/apt/apt.conf.d/00aptitude
Notice that the character ">" is repeated twice. With one single character, you would overwrite what currently is in /etc/apt/apt.conf.d/00aptitude!