Traditional TSK system employs standard membership functions with adjustable crisp parameters in the IF part and linear combinations of input variables in the THEN part, which leads to loss of data fuzziness. Moreover, linear THEN part of this system restricts the number of learning parameters. On the other hand, parameters of the system are tuned to meet a predefined error threshold, but the system does not necessarily display actual structure of data, which impairs its interpretability. This work proposes modifications to the TSK system to tackle these issues and improve its performance. Extended TSK System (ETSK) is presented by replacing crisp parameters of membership functions with fuzzy numbers and adopting arbitrary functions in THEN part of the system. In addition, a Clustering-based TSK system (CTSK) is proposed, which is established from fuzzy clustering algorithms and represents structures and patterns of the data. CTSK has no IF part parameters to tune, which makes the system much faster, but its THEN part is the same as ETSK. Finally, CETSK system is presented as a combination of CTSK and ETSK to study the possibility of further improvements of the systems. The IF parts of TSK, ETSK, and CETSK are tuned by genetic algorithms and their THEN parts are adjusted by the least-squares estimate method. Performance of the systems are studied using 22 datasets in terms of accuracy and runtime. On average, CTSK is 10.82% and 4.84% more accurate than TSK and CETSK; and 91.58% and 92.21% faster than these systems, respectively. CETSK is 6.27% more accurate than TSK, but 6.91% slower because fuzzy clustering and genetic algorithms are jointly employed to tune its IF part whereas only genetic algorithms is used in TSK for this purpose.