tasksh provides an interactive shell with readline support for taskwarrior-2.4.0 and later.