The secretion of insulin and glucagon by pancreatic β and α cells, respectively, is critical for glucose homeostasis. While the insulin granule dynamics is well-characterized, the intracellular behavior of glucagon secretory granules (GSG) remains poorly understood. Here, we analyze the mobility of GSGs in α cells and insulin secretory granules (ISG) in β cells using spatiotemporal correlation spectroscopy and single-particle tracking (SPT), with a focus on the role of the cytoskeleton. Under basal conditions, SPT classification reveals that GSGs predominantly exhibit diffusive motion (57.6 ± 10%), with smaller fractions categorized as immobile (35.8 ± 10.6%) or drifted (6.6 ± 3%), resembling ISGs dynamics. By disrupting microtubules, we confirmed their role as active tracks for directed granule transport in both cell types. However, actin depolymerization, which enhances ISGs directed motion, has little effect on GSGs and instead increases their immobile fraction. This differential behavior persists under physiological secretory stimuli - high glucose for β cells and low glucose for α cells - indicating that, while both systems employ the cytoskeleton for secretion, α and β cells exhibit distinct recruitment and utilization patterns. These findings suggest that α and β cells may modulate granule dynamics differently to meet their specific secretory demands.