He only wants to sleep with you and nothing more. Being busy is understandable but your a woman and you have needs as well. Its not right that only his needs are being met (weekends). Its understandable to be busy but by not picking up the phone or talking to you during weekdays is no excuse.
He could easily call weeknights before bed or during breaks.
Dating is more than sex such as doing other activities.
Movies, dates, dinner, or whatever. You should open and clear things up so that this relationship is balanced.