Holden still hates to see Luce go because Holden feels lonely and is running out of people to call. He knows that he doesn't really have anyone else to depend on, and losing someone now would be the last thing he needs. It's something that he wouldn't be able to cope with.