Amyloid-like protein aggregation is associated with neurodegeneration and other pathologies. The nature of the toxic aggregate species and their mechanism of action remain elusive. Here, we analyzed the compartment specificity of aggregate toxicity using artificial β-sheet proteins, as well as fragments of mutant huntingtin and TAR DNA binding protein-43 (TDP-43). Aggregation in the cytoplasm interfered with nucleocytoplasmic protein and RNA transport. In contrast, the same proteins did not inhibit transport when forming inclusions in the nucleus at or around the nucleolus. Protein aggregation in the cytoplasm, but not the nucleus, caused the sequestration and mislocalization of proteins containing disordered and low-complexity sequences, including multiple factors of the nuclear import and export machinery. Thus, impairment of nucleocytoplasmic transport may contribute to the cellular pathology of various aggregate deposition diseases.