I'd use MySQL in a production environment, as its faster, however having an SQLite file can be handy for testing environments and might suffice for a low traffic site
Learning - well they both have the same SQL language to learn, though SQLite doesn't support all of the keywords that the bigger...