No damage will occur using only the kick start.
If you continue to use the electric start, metal shavings from the starter clutch can get into the crankcase oil and there is a chance the starter clutch could break and cause serious damage to the engine.
